Sep 25 12:30:11 devstack cinder-volume[76083]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:30:11 devstack cinder-volume[76083]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:30:11 devstack cinder-volume[76083]: we strongly recommend against using it for new projects. Sep 25 12:30:11 devstack cinder-volume[76083]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:30:11 devstack cinder-volume[76083]: framework. For more detail see Sep 25 12:30:11 devstack cinder-volume[76083]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:30:11 devstack cinder-volume[76083]: import eventlet # noqa Sep 25 12:30:14 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:30:14 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:30:14 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:30:15 devstack cinder-volume[76083]: INFO dbcounter [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Registered counter for database cinder Sep 25 12:30:15 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:30:15 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writer thread running {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:30:15 devstack cinder-volume[76083]: INFO cinder.rpc [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:30:15 devstack cinder-volume[76083]: INFO cinder.rpc [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:30:15 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:30:15 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Determined volume DB was empty at startup. Sep 25 12:30:15 devstack cinder-volume[76083]: DEBUG cinder.volume.manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:30:16 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 12:30:16 devstack cinder-volume[76083]: WARNING stevedore.named [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:30:16 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:30:16 devstack cinder-volume[76083]: WARNING cinder.keymgr.conf_key_mgr [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG cinder.volume.drivers.lvm [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76083) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_concurrency.processutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] CMD "cinder-rtstool verify" returned: 0 in 0.440s {{(pid=76083) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:30:16 devstack cinder-volume[76083]: INFO cinder.rpc [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 12:30:16 devstack cinder-volume[76083]: INFO cinder.rpc [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 12:30:16 devstack cinder-volume[76083]: WARNING stevedore.named [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:30:16 devstack cinder-volume[76083]: WARNING castellan.key_manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:30:16 devstack cinder-volume[76083]: INFO cinder.volume.manager [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_db.sqlalchemy.engines [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:30:16 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Starting 1 workers Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Started child 76240 {{(pid=76083) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Full set of CONF: {{(pid=76083) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Configuration options gathered from: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] ================================================================================ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] allow_availability_zone_fallback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] allow_compression_on_image_upload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] allowed_direct_url_schemes = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] api_rate_limit = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] auth_strategy = keystone {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] az_cache_duration = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_host = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_stats_polling_interval = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backup_api_class = cinder.backup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backup_name_template = backup-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backup_use_same_host = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backup_use_temp_snapshot = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] chap_username = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_internal_tenant_project_id = 568cd698150148cba8f49f158f1be10a {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_internal_tenant_user_id = 3cb9b65bfdeb4276803aca078993dba2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cloned_volume_same_az = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cluster = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] compression_format = gzip {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] compute_api_class = cinder.compute.nova.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76240]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] config_dir = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] config_source = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] control_exchange = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] debug = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] default_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] default_group_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] default_volume_type = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_ssl_cert_verify = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] driver_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] enable_force_upload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] enable_new_services = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] enable_unsupported_driver = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_api_insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_api_ssl_compression = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_ca_certificates_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_catalog_info = image:glance:publicURL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_num_retries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance_request_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] graceful_shutdown_timeout = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] group_api_class = cinder.group.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] host = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_compress_on_upload = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_conversion_address_space_limit = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_conversion_cpu_limit = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_conversion_disable = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_introspection_address_space_limit = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_introspection_cpu_limit = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_volume_cache_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_volume_cache_max_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] init_host_max_objects_retrieval = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] instance_format = [instance: %(uuid)s] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iscsi_target_flags = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iscsi_write_cache = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iser_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iser_ip_address = 192.168.122.213 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iser_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_color = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_config_append = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_options = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_rotate_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_rotate_interval_type = days {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] log_rotation_type = none {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] max_age = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] max_logfile_count = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] max_logfile_size_mb = 200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] max_over_subscription_ratio = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] message_reap_interval = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] message_ttl = 2592000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] migration_create_volume_timeout_secs = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] monkey_patch = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] monkey_patch_modules = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] my_ip = 192.168.122.213 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] no_snapshot_gb_quota = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] num_iser_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] num_shell_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] num_volume_device_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] nvmeof_conn_info_version = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] nvmet_ns_id = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] nvmet_port_id = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_max_limit = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_ext_list = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_listen_port = 8776 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] osapi_volume_workers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] per_volume_size_limit = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] periodic_fuzzy_delay = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] periodic_interval = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] public_endpoint = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] publish_errors = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_backup_gigabytes = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_backups = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_gigabytes = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_groups = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_snapshots = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] quota_volumes = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] rate_limit_burst = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] rate_limit_except_level = CRITICAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] rate_limit_interval = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] reinit_driver_count = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] report_discard_supported = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] report_interval = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] reservation_clean_interval = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] reservation_expire = 86400 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] reserved_image_namespaces = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] reserved_percentage = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] rpc_response_timeout = 120 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] run_external_periodic_tasks = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] scst_target_driver = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_down_time = 720 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] shell_completion = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] snapshot_name_template = snapshot-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] snapshot_same_host = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76240]: INFO cinder.volume.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] state_path = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] storage_availability_zone = nova {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] storage_protocol = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] syslog_log_facility = LOG_USER {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_helper = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_ip_address = 192.168.122.213 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] target_secondary_ip_addresses = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] transport_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] until_refresh = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_chap_auth = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_default_quota_class = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_journal = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_json = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_stderr = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] use_syslog = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] verify_glance_signatures = enabled {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_api_class = cinder.volume.api.API {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_clear_size = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_copy_bps_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_dd_blocksize = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_name_template = volume-%s {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_service_inithost_offload = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volume_usage_audit_period = month {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] zoning_mode = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_concurrency.disable_process_locking = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.auth_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.cache = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.include_service_catalog = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.interface = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcache_username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.service_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:16 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.backend = dogpile.cache.null {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.backend_argument = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.backend_expiration_time = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.config_prefix = cache.oslo {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.debug_cache_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.enable_retry_client = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.enable_socket_keepalive = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.expiration_time = 600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.hashclient_retry_attempts = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_dead_retry = 300 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_pool_maxsize = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_sasl_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.proxies = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.redis_db = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.redis_server = localhost:6379 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.retry_attempts = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.retry_delay = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.socket_keepalive_count = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.socket_keepalive_idle = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.socket_keepalive_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.socket_timeout = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.tls_allowed_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.tls_cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.tls_certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:16 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.tls_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.tls_keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cache.username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] coordination.backend_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.asyncio_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.asyncio_slave_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.backend = sqlalchemy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.connection_debug = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.connection_parameters = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.connection_recycle_time = 3600 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.connection_trace = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.db_inc_retry_interval = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.db_max_retries = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.db_max_retry_interval = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.db_retry_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.max_overflow = 50 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.max_pool_size = 5 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.max_retries = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.mysql_wsrep_sync_wait = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.pool_timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.retry_interval = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.slave_connection = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.sqlite_synchronous = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.synchronous_reader = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:16 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] database.use_db_reconnect = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_tracing.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.connection_string = messaging:// {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.es_doc_type = notification {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.es_scroll_size = 10000 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.es_scroll_time = 2m {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.filter_error_trace = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.hmac_keys = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.sentinel_service_name = mymaster {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.socket_timeout = 0.1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.trace_requests = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler.trace_sqlalchemy = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler_jaeger.process_tags = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler_jaeger.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] profiler_otlp.service_name_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.enforce_new_defaults = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.policy_default_rule = default {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.policy_file = policy.yaml {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.group = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] privsep_osbrick.user = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.group = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.helper_command = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] cinder_sys_admin.user = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.send_service_user_token = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] service_user.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.auth_type = password {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 12:30:17 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] glance.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.chap_username = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.driver_use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.extra_capabilities = {} {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iscsi_target_flags = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iscsi_write_cache = on {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iser_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iser_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.lvm_share_target = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.lvm_type = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.num_shell_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.report_discard_supported = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.reserved_percentage = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_helper = tgtadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.unique_fqdn_network = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.use_chap_auth = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_backend_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_clear_size = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_reports.file_event_handler = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_reports.log_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.backend_host = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.chap_password = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.chap_username = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.disk_geometry = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_client_cert = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.extra_capabilities = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.filter_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.goodness_function = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iser_helper = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iser_ip_address = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iser_port = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.lvm_share_target = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.lvm_type = auto {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.num_shell_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.replication_device = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.report_discard_supported = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.reserved_percentage = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.scst_target_driver = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.storage_protocol = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_helper = lioadm {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_ip_address = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_port = 3260 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.trace_flags = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.use_chap_auth = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_clear = zero {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_clear_size = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] lvmdriver-1.volumes_dir = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_notifications.driver = [] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_notifications.retry = -1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] key_manager.fixed_key = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.barbican_api_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.barbican_endpoint = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.barbican_endpoint_type = public {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.barbican_region_name = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.number_of_retries = 60 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.retry_delay = 1 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.send_service_user_token = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.verify_ssl = True {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican.verify_ssl_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.auth_section = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.auth_type = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.cafile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.certfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.collect_timing = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.insecure = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.keyfile = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.split_loggers = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.timeout = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.tls_ciphers = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] barbican_service_user.tls_min_version = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.approle_role_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.approle_secret_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.auth_method = approle {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.auth_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.kv_mountpoint = secret {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.kv_path = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.kv_version = 2 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.namespace = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.root_token_id = **** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.ssl_ca_crt_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.timeout = 60.0 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.token_file = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.token_role = None {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.use_ssl = False {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:30:17 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] ******************************************************************************** {{(pid=76083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:30:17 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:17 devstack sudo[76282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:17 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:17 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.269s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:30:17 devstack cinder-volume[76240]: INFO cinder.brick.local_dev.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:17 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:17 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:17 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG cinder.brick.local_dev.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76240) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 12:30:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:17 devstack sudo[76539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:17 devstack sudo[76539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:18 devstack sudo[76539]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:18 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:18 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:18 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:18 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 12:30:18 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:19 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.273s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:19 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:19 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:19 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:19 devstack sudo[76939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:19 devstack sudo[76939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:19 devstack sudo[76939]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:19 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:19 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:19 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:20 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:20 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:20 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:20 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.364s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:20 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:20 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:20 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:20 devstack cinder-volume[76240]: INFO cinder.volume.drivers.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:20 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:20 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:20 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:21 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:21 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:21 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:21 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:21 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:21 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:21 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:21 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:21 devstack sudo[77055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:21 devstack sudo[77055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:22 devstack sudo[77055]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:22 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:22 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:22 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:22 devstack cinder-volume[76240]: INFO cinder.volume.driver [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG cinder.volume.driver [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76240) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_db.sqlalchemy.engines [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writer thread running {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG cinder.db.api [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Building query based on filter {{(pid=76240) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG cinder.image.image_utils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76240) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:30:22 devstack cinder-volume[76240]: INFO cinder.keymgr.migration [None req-99e21ecb-495a-4cb1-b2b6-6cdfa1195910 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:22 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:22 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:22 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:22 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:22 devstack sudo[77068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:22 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:23 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:23 devstack sudo[77071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:23 devstack sudo[77071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:23 devstack sudo[77071]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:23 devstack sudo[77074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:23 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:23 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG cinder.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Notifying Schedulers of capabilities ... {{(pid=76240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:30:23 devstack cinder-volume[76240]: INFO cinder.volume.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Driver initialization completed successfully. Sep 25 12:30:23 devstack cinder-volume[76240]: INFO cinder.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Initiating service 2 cleanup Sep 25 12:30:23 devstack cinder-volume[76240]: INFO cinder.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Service 2 cleanup completed. Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG cinder.service [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Creating RPC server for service cinder-volume {{(pid=76240) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:30:23 devstack cinder-volume[76240]: DEBUG cinder.service [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76240) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:30:23 devstack cinder-volume[76240]: INFO cinder.volume.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:24 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:30:24 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:24 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:24 devstack sudo[77083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:24 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:24 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:24 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:30:24 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:24 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:24 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:30:24 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:30:24 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:30:25 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Sep 25 12:30:25 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:30:25 devstack cinder-volume[76240]: INFO cinder.volume.manager [None req-e38d9f54-b737-48b0-afdc-f41c9d4f30ee None None] Driver post RPC initialization completed successfully. Sep 25 12:30:26 devstack cinder-volume[76083]: DEBUG dbcounter [-] [76083] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:30:35 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writing DB stats cinder:SELECT=3 {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:30:35 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:31:17 devstack sudo[78960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:31:17 devstack sudo[78960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:31:17 devstack sudo[78960]: pam_unix(sudo:session): session closed for user root Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:31:17 devstack sudo[78963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:31:17 devstack sudo[78963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:31:17 devstack sudo[78963]: pam_unix(sudo:session): session closed for user root Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:31:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:31:17 devstack sudo[78966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:31:17 devstack sudo[78966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:31:18 devstack sudo[78966]: pam_unix(sudo:session): session closed for user root Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:31:18 devstack sudo[78969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:31:18 devstack sudo[78969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:31:18 devstack sudo[78969]: pam_unix(sudo:session): session closed for user root Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG cinder.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Notifying Schedulers of capabilities ... {{(pid=76240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager._thread_info {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread count: 6 {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:31:18 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread info: [<_MainThread(MainThread, started 133485642002560)>, , , , , ] {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:32:17 devstack sudo[82330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:32:17 devstack sudo[82330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:32:17 devstack sudo[82330]: pam_unix(sudo:session): session closed for user root Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:32:17 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:32:17 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:32:17 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:32:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:32:17 devstack sudo[82337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:32:17 devstack sudo[82337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:32:18 devstack sudo[82337]: pam_unix(sudo:session): session closed for user root Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:32:18 devstack sudo[82340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:32:18 devstack sudo[82340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:32:18 devstack sudo[82340]: pam_unix(sudo:session): session closed for user root Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG cinder.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Notifying Schedulers of capabilities ... {{(pid=76240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager._thread_info {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread count: 6 {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:32:18 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread info: [<_MainThread(MainThread, started 133485642002560)>, , , , , ] {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:32:35 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG cinder.volume.drivers.lvm [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Updating volume stats {{(pid=76240) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:17 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:17 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:17 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:17 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:17 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:17 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.375s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:17 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:17 devstack sudo[83859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:17 devstack sudo[83859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:18 devstack sudo[83859]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:18 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:18 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:18 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:18 devstack cinder-volume[76240]: DEBUG oslo_concurrency.processutils [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:18 devstack cinder-volume[76240]: DEBUG cinder.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Notifying Schedulers of capabilities ... {{(pid=76240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:34:17 devstack cinder-volume[76240]: DEBUG oslo_service.periodic_task [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] Running periodic task VolumeManager._thread_info {{(pid=76240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:34:17 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread count: 6 {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:34:17 devstack cinder-volume[76240]: DEBUG cinder.volume.manager [None req-6c1ada93-ee79-4032-ab9b-9dc6a2970961 None None] thread info: [<_MainThread(MainThread, started 133485642002560)>, , , , , ] {{(pid=76240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:34:35 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writing DB stats cinder:SELECT=1 {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:34:35 devstack cinder-volume[76240]: DEBUG dbcounter [-] [76240] Writing DB stats cinder:UPDATE=1 {{(pid=76240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:35:12 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Caught SIGTERM, stopping children Sep 25 12:35:12 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Acquiring lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:12 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Acquired lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:12 devstack cinder-volume[76083]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Releasing lock "singleton_lock" {{(pid=76083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:12 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Stop services. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 12:35:12 devstack cinder-volume[76083]: DEBUG oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Killing children. {{(pid=76083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 12:35:12 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Waiting on 1 children to exit Sep 25 12:35:13 devstack cinder-volume[76240]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Acquiring lock "singleton_lock" {{(pid=76240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:13 devstack cinder-volume[76240]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Acquired lock "singleton_lock" {{(pid=76240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:13 devstack cinder-volume[76240]: DEBUG oslo_concurrency.lockutils [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Releasing lock "singleton_lock" {{(pid=76240) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:13 devstack cinder-volume[76240]: WARNING amqp [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:35:14 devstack cinder-volume[76240]: WARNING amqp [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:35:14 devstack cinder-volume[76083]: INFO oslo_service.backend._eventlet.service [None req-a3472f68-432c-4231-8dbf-f50c6755b28f None None] Child 76240 exited with status 0 Sep 25 12:35:14 devstack cinder-volume[86309]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:35:14 devstack cinder-volume[86309]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:35:14 devstack cinder-volume[86309]: we strongly recommend against using it for new projects. Sep 25 12:35:14 devstack cinder-volume[86309]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:35:14 devstack cinder-volume[86309]: framework. For more detail see Sep 25 12:35:14 devstack cinder-volume[86309]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:35:14 devstack cinder-volume[86309]: import eventlet # noqa Sep 25 12:35:16 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:16 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:16 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:17 devstack cinder-volume[86309]: INFO dbcounter [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Registered counter for database cinder Sep 25 12:35:17 devstack cinder-volume[86309]: DEBUG oslo_db.sqlalchemy.engines [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:17 devstack cinder-volume[86309]: DEBUG dbcounter [-] [86309] Writer thread running {{(pid=86309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:35:17 devstack cinder-volume[86309]: INFO cinder.rpc [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:35:17 devstack cinder-volume[86309]: INFO cinder.rpc [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:35:17 devstack cinder-volume[86309]: DEBUG oslo_db.sqlalchemy.engines [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:17 devstack cinder-volume[86309]: INFO cinder.volume.manager [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Determined volume DB was empty at startup. Sep 25 12:35:17 devstack cinder-volume[86309]: DEBUG cinder.volume.manager [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86309) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:35:17 devstack cinder-volume[86309]: INFO cinder.volume.manager [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 12:35:17 devstack cinder-volume[86309]: WARNING stevedore.named [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:35:17 devstack cinder-volume[86309]: WARNING castellan.key_manager [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:35:17 devstack cinder-volume[86309]: WARNING cinder.keymgr.conf_key_mgr [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:35:18 devstack cinder-volume[86309]: INFO cinder.volume.manager [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_db.sqlalchemy.engines [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:18 devstack cinder-volume[86309]: INFO oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Starting 1 workers Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Started child 86526 {{(pid=86309) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Full set of CONF: {{(pid=86309) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] ******************************************************************************** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Configuration options gathered from: {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] ================================================================================ {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] allow_availability_zone_fallback = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] allow_compression_on_image_upload = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] allowed_direct_url_schemes = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] api_rate_limit = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] auth_strategy = keystone {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_availability_zone = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_host = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_stats_polling_interval = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backup_api_class = cinder.backup.api.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backup_name_template = backup-%s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backup_use_same_host = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backup_use_temp_snapshot = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] chap_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] chap_username = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_internal_tenant_project_id = 568cd698150148cba8f49f158f1be10a {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_internal_tenant_user_id = 3cb9b65bfdeb4276803aca078993dba2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cluster = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] compression_format = gzip {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] compute_api_class = cinder.compute.nova.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] config_dir = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] config_source = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86526]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] control_exchange = openstack {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] debug = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] default_availability_zone = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] default_group_type = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] default_volume_type = QuobyteHD {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] disk_geometry = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_client_cert = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_client_cert_key = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_data_namespace = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_ssl_cert_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_ssl_cert_verify = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] driver_use_ssl = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] enable_new_services = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] enable_unsupported_driver = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] enabled_backends = ['QuobyteHD'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] enforce_multipath_for_image_xfer = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] filter_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_api_insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_api_ssl_compression = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_ca_certificates_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_catalog_info = image:glance:publicURL {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_num_retries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance_request_timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] goodness_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] graceful_shutdown_timeout = 5 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] group_api_class = cinder.group.api.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] host = devstack {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_compress_on_upload = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_conversion_address_space_limit = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_conversion_cpu_limit = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_conversion_disable = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_introspection_address_space_limit = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_introspection_cpu_limit = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_upload_use_cinder_backend = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_upload_use_internal_tenant = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_volume_cache_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_volume_cache_max_count = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] image_volume_cache_max_size_gb = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] init_host_max_objects_retrieval = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] instance_format = [instance: %(uuid)s] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iscsi_target_flags = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iscsi_write_cache = on {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iser_helper = tgtadm {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iser_ip_address = 192.168.122.213 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iser_port = 3260 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_color = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_config_append = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_dir = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_options = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_rotate_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_rotate_interval_type = days {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] log_rotation_type = none {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] max_age = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] max_logfile_count = 30 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] max_logfile_size_mb = 200 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] max_over_subscription_ratio = 20.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] message_reap_interval = 86400 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] message_ttl = 2592000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] migration_create_volume_timeout_secs = 300 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] monkey_patch = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] monkey_patch_modules = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] my_ip = 192.168.122.213 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] no_snapshot_gb_quota = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] num_iser_scan_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] num_shell_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] num_volume_device_scan_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] nvmeof_conn_info_version = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] nvmet_ns_id = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] nvmet_port_id = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_max_limit = 1000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_ext_list = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_listen_port = 8776 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_use_ssl = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] osapi_volume_workers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] per_volume_size_limit = -1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] periodic_fuzzy_delay = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] periodic_interval = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] public_endpoint = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] publish_errors = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_backup_gigabytes = 1000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_backups = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_gigabytes = 1000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_groups = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_snapshots = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] quota_volumes = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] rate_limit_burst = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] rate_limit_except_level = CRITICAL {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] rate_limit_interval = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] reinit_driver_count = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] replication_device = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] report_discard_supported = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] report_interval = 120 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] reservation_clean_interval = 86400 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] reservation_expire = 86400 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] reserved_image_namespaces = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] reserved_percentage = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] rpc_response_timeout = 120 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] run_external_periodic_tasks = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] scst_target_driver = iscsi {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] scst_target_iqn_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_down_time = 720 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] shell_completion = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] snapshot_name_template = snapshot-%s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] split_loggers = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] state_path = /opt/stack/data/cinder {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] storage_availability_zone = nova {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] storage_protocol = iSCSI {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] syslog_log_facility = LOG_USER {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_helper = lioadm {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_ip_address = 192.168.122.213 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_port = 3260 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_protocol = iscsi {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] target_secondary_ip_addresses = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] trace_flags = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] transport_url = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] until_refresh = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_chap_auth = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_default_quota_class = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_journal = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_json = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_multipath_for_image_xfer = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_stderr = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] use_syslog = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] verify_glance_signatures = enabled {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_api_class = cinder.volume.api.API {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_backend_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_clear = zero {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_clear_ionice = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_clear_size = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_copy_bps_limit = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_dd_blocksize = 1M {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_name_template = volume-%s {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_service_inithost_offload = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volume_usage_audit_period = month {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] zoning_mode = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_concurrency.disable_process_locking = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.auth_section = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.auth_type = password {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.auth_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.cache = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.include_service_catalog = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.interface = public {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcache_username = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.region_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.service_type = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.backend = dogpile.cache.null {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.backend_argument = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.backend_expiration_time = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.config_prefix = cache.oslo {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.debug_cache_backend = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.enable_retry_client = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.enable_socket_keepalive = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.expiration_time = 600 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.hashclient_retry_attempts = 2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_dead_retry = 300 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_pool_maxsize = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_sasl_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.proxies = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.redis_db = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86526) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.redis_server = localhost:6379 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.retry_attempts = 2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.retry_delay = 0.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.socket_keepalive_count = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.socket_keepalive_idle = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.socket_keepalive_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.socket_timeout = 1.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.tls_allowed_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.tls_cafile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.tls_certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.tls_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.tls_keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cache.username = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] coordination.backend_url = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.asyncio_connection = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.asyncio_slave_connection = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.backend = sqlalchemy {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.connection = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.connection_debug = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.connection_parameters = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.connection_recycle_time = 3600 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.connection_trace = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.db_inc_retry_interval = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.db_max_retries = 20 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.db_max_retry_interval = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.db_retry_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.max_overflow = 50 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.max_pool_size = 5 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.max_retries = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.mysql_wsrep_sync_wait = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.pool_timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.retry_interval = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.slave_connection = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.sqlite_synchronous = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.synchronous_reader = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] database.use_db_reconnect = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_tracing.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.connection_string = messaging:// {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.es_doc_type = notification {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.es_scroll_size = 10000 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.es_scroll_time = 2m {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.filter_error_trace = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.hmac_keys = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.sentinel_service_name = mymaster {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.socket_timeout = 0.1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.trace_requests = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler.trace_sqlalchemy = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler_jaeger.process_tags = {} {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler_jaeger.service_name_prefix = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] profiler_otlp.service_name_prefix = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.enforce_new_defaults = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.policy_default_rule = default {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.policy_file = policy.yaml {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.group = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.helper_command = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] privsep_osbrick.user = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.group = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.helper_command = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] cinder_sys_admin.user = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.auth_section = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.auth_type = password {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.cafile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.collect_timing = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.send_service_user_token = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.split_loggers = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.tls_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] service_user.tls_min_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.auth_section = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.auth_type = password {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.collect_timing = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.region_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.split_loggers = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.tls_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] glance.tls_min_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.backend_availability_zone = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.chap_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.chap_username = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.disk_geometry = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_client_cert = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_client_cert_key = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_data_namespace = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.driver_use_ssl = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.extra_capabilities = {} {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.filter_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.goodness_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iscsi_target_flags = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iscsi_write_cache = on {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iser_helper = tgtadm {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iser_port = 3260 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_host = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_login = admin {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_mount_options = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_private_key = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_share_path = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.num_shell_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.quobyte_volume_url = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.replication_device = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.report_discard_supported = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.reserved_percentage = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_helper = tgtadm {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_port = 3260 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_protocol = iscsi {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.trace_flags = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.unique_fqdn_network = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.use_chap_auth = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_backend_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_clear = zero {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_clear_ionice = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_clear_size = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_reports.file_event_handler = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_reports.log_dir = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.backend_availability_zone = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.backend_host = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.chap_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.chap_username = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.chiscsi_conf = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.disk_geometry = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_client_cert = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_data_namespace = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.driver_use_ssl = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.extra_capabilities = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.filter_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.goodness_function = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iser_helper = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iser_ip_address = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iser_port = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.iser_target_prefix = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_host = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_login = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_mount_options = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_password = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_private_key = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_share_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_ssh_port = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.num_shell_tries = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.nvmet_port_id = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.replication_device = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.report_discard_supported = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.reserved_percentage = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.scst_target_driver = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.storage_protocol = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_helper = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_ip_address = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_port = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_prefix = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_protocol = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.trace_flags = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.use_chap_auth = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_clear = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_clear_size = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] QuobyteHD.volumes_dir = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_notifications.driver = [] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_notifications.retry = -1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] key_manager.fixed_key = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.barbican_api_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.barbican_endpoint = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.barbican_endpoint_type = public {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.barbican_region_name = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.cafile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.collect_timing = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.number_of_retries = 60 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.retry_delay = 1 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.send_service_user_token = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.split_loggers = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.tls_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.tls_min_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.verify_ssl = True {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican.verify_ssl_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.auth_section = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.auth_type = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.cafile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.certfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.collect_timing = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.insecure = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.keyfile = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.split_loggers = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.timeout = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.tls_ciphers = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] barbican_service_user.tls_min_version = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.approle_role_id = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.approle_secret_id = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.auth_method = approle {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.auth_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.kv_mountpoint = secret {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.kv_path = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.kv_version = 2 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.namespace = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.root_token_id = **** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.ssl_ca_crt_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.timeout = 60.0 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.token_file = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.token_role = None {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.use_ssl = False {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:18 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] ******************************************************************************** {{(pid=86309) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86526) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 12:35:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 12:35:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Running cmd (subprocess): mount.quobyte {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:18 devstack quobyte-client[86527]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 12:35:18 devstack quobyte-client[86527]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 ... Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 -c /etc/quobyte/client-cinder.cfg {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:18 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 -c /etc/quobyte/client-cinder.cfg Sep 25 12:35:18 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:18 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.481s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 succeeded Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.494s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:19 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:19 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:19 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.volume.driver [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.driver [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4082221984863, 'free_capacity_gb': 1775.4082221984863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writer thread running {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.db.api [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Building query based on filter {{(pid=86526) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.keymgr.migration [None req-c1e45c22-18c9-444d-9fcc-8327019dbfb3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:19 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:19 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:19 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Driver initialization completed successfully. Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Initiating service 3 cleanup Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Service 3 cleanup completed. Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.service [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Creating RPC server for service cinder-volume {{(pid=86526) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.service [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86526) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:35:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:20 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:20 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:20 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.314s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e395c49-8028-461e-885a-0bd5a44ec37e None None] Driver post RPC initialization completed successfully. Sep 25 12:35:23 devstack cinder-volume[86309]: INFO oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Caught SIGTERM, stopping children Sep 25 12:35:23 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Acquiring lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:23 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Acquired lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:23 devstack cinder-volume[86309]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Releasing lock "singleton_lock" {{(pid=86309) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:23 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Stop services. {{(pid=86309) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 12:35:23 devstack cinder-volume[86309]: DEBUG oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Killing children. {{(pid=86309) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 12:35:23 devstack cinder-volume[86309]: INFO oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Waiting on 1 children to exit Sep 25 12:35:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Acquiring lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Acquired lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Releasing lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:24 devstack cinder-volume[86526]: WARNING amqp [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:35:24 devstack cinder-volume[86526]: WARNING amqp [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:35:24 devstack cinder-volume[86309]: INFO oslo_service.backend._eventlet.service [None req-32da86c2-aebf-4db7-9785-ea37aaf71c96 None None] Child 86526 exited with status 0 Sep 25 12:35:24 devstack cinder-volume[86823]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:35:24 devstack cinder-volume[86823]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:35:24 devstack cinder-volume[86823]: we strongly recommend against using it for new projects. Sep 25 12:35:24 devstack cinder-volume[86823]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:35:24 devstack cinder-volume[86823]: framework. For more detail see Sep 25 12:35:24 devstack cinder-volume[86823]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:35:24 devstack cinder-volume[86823]: import eventlet # noqa Sep 25 12:35:27 devstack cinder-volume[86823]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86823) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:35:27 devstack cinder-volume[86823]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86823) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:35:27 devstack cinder-volume[86823]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86823) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:35:28 devstack cinder-volume[86823]: INFO dbcounter [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Registered counter for database cinder Sep 25 12:35:29 devstack cinder-volume[86823]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:29 devstack cinder-volume[86823]: DEBUG dbcounter [-] [86823] Writer thread running {{(pid=86823) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:35:29 devstack cinder-volume[86823]: INFO cinder.rpc [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:35:29 devstack cinder-volume[86823]: INFO cinder.rpc [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:35:29 devstack cinder-volume[86823]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:29 devstack cinder-volume[86823]: INFO cinder.volume.manager [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Determined volume DB was empty at startup. Sep 25 12:35:29 devstack cinder-volume[86823]: DEBUG cinder.volume.manager [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86823) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:35:29 devstack cinder-volume[86823]: WARNING stevedore.named [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:35:29 devstack cinder-volume[86823]: WARNING castellan.key_manager [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:35:29 devstack cinder-volume[86823]: WARNING cinder.keymgr.conf_key_mgr [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:35:29 devstack cinder-volume[86823]: INFO cinder.volume.manager [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 12:35:29 devstack cinder-volume[86823]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:30 devstack cinder-volume[86823]: INFO oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Starting 1 workers Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Started child 87094 {{(pid=86823) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Full set of CONF: {{(pid=86823) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] ******************************************************************************** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] Configuration options gathered from: {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] ================================================================================ {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] allow_availability_zone_fallback = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] allow_compression_on_image_upload = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] allowed_direct_url_schemes = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] api_rate_limit = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[87094]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] auth_strategy = keystone {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_availability_zone = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_host = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_stats_polling_interval = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backup_api_class = cinder.backup.api.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backup_name_template = backup-%s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backup_use_same_host = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backup_use_temp_snapshot = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] chap_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] chap_username = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_internal_tenant_project_id = 568cd698150148cba8f49f158f1be10a {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_internal_tenant_user_id = 3cb9b65bfdeb4276803aca078993dba2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cluster = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] compression_format = gzip {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] compute_api_class = cinder.compute.nova.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] config_dir = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] config_source = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] control_exchange = openstack {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] debug = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] default_availability_zone = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] default_group_type = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] default_volume_type = QuobyteHD {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] disk_geometry = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_client_cert = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_client_cert_key = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_data_namespace = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_ssl_cert_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_ssl_cert_verify = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] driver_use_ssl = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] enable_new_services = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] enable_unsupported_driver = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] enabled_backends = ['QuobyteHD'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] enforce_multipath_for_image_xfer = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] filter_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_api_insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_api_ssl_compression = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_ca_certificates_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_catalog_info = image:glance:publicURL {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_num_retries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance_request_timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] goodness_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] graceful_shutdown_timeout = 5 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] group_api_class = cinder.group.api.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] host = devstack {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_compress_on_upload = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_conversion_address_space_limit = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_conversion_cpu_limit = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_conversion_disable = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_introspection_address_space_limit = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_introspection_cpu_limit = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_upload_use_cinder_backend = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_upload_use_internal_tenant = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_volume_cache_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_volume_cache_max_count = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] image_volume_cache_max_size_gb = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] init_host_max_objects_retrieval = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] instance_format = [instance: %(uuid)s] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iscsi_target_flags = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iscsi_write_cache = on {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iser_helper = tgtadm {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iser_ip_address = 192.168.122.213 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iser_port = 3260 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_color = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_config_append = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_dir = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_options = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_rotate_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_rotate_interval_type = days {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] log_rotation_type = none {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] max_age = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] max_logfile_count = 30 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] max_logfile_size_mb = 200 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] max_over_subscription_ratio = 20.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] message_reap_interval = 86400 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] message_ttl = 2592000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] migration_create_volume_timeout_secs = 300 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] monkey_patch = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] monkey_patch_modules = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] my_ip = 192.168.122.213 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] no_snapshot_gb_quota = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] num_iser_scan_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] num_shell_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] num_volume_device_scan_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] nvmeof_conn_info_version = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] nvmet_ns_id = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] nvmet_port_id = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_max_limit = 1000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_ext_list = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_listen_port = 8776 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_use_ssl = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] osapi_volume_workers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] per_volume_size_limit = -1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] periodic_fuzzy_delay = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] periodic_interval = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] public_endpoint = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] publish_errors = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_backup_gigabytes = 1000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_backups = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_gigabytes = 1000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_groups = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_snapshots = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] quota_volumes = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] rate_limit_burst = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] rate_limit_except_level = CRITICAL {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] rate_limit_interval = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] reinit_driver_count = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] replication_device = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] report_discard_supported = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] report_interval = 120 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87094) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] reservation_clean_interval = 86400 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] reservation_expire = 86400 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] reserved_image_namespaces = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] reserved_percentage = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] rpc_response_timeout = 120 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] run_external_periodic_tasks = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] scst_target_driver = iscsi {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] scst_target_iqn_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_down_time = 720 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] shell_completion = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] snapshot_name_template = snapshot-%s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] split_loggers = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] state_path = /opt/stack/data/cinder {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] storage_availability_zone = nova {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] storage_protocol = iSCSI {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] syslog_log_facility = LOG_USER {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_helper = lioadm {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_ip_address = 192.168.122.213 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_port = 3260 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_protocol = iscsi {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] target_secondary_ip_addresses = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] trace_flags = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] transport_url = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] until_refresh = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_chap_auth = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_default_quota_class = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_journal = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_json = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_multipath_for_image_xfer = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_stderr = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] use_syslog = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] verify_glance_signatures = enabled {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_api_class = cinder.volume.api.API {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_backend_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_clear = zero {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_clear_ionice = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_clear_size = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_copy_bps_limit = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_dd_blocksize = 1M {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_name_template = volume-%s {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_service_inithost_offload = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volume_usage_audit_period = month {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] zoning_mode = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_concurrency.disable_process_locking = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.auth_section = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.auth_type = password {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.auth_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.cache = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.include_service_catalog = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.interface = public {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcache_username = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.region_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.service_type = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.backend = dogpile.cache.null {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.backend_argument = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.backend_expiration_time = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.config_prefix = cache.oslo {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.debug_cache_backend = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.enable_retry_client = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.enable_socket_keepalive = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.expiration_time = 600 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.hashclient_retry_attempts = 2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_dead_retry = 300 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_pool_maxsize = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_sasl_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.proxies = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.redis_db = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.redis_server = localhost:6379 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.retry_attempts = 2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.retry_delay = 0.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.socket_keepalive_count = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.socket_keepalive_idle = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.socket_keepalive_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.socket_timeout = 1.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.tls_allowed_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.tls_cafile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.tls_certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.tls_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.tls_keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cache.username = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] coordination.backend_url = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.asyncio_connection = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.asyncio_slave_connection = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.backend = sqlalchemy {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.connection = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.connection_debug = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.connection_parameters = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.connection_recycle_time = 3600 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.connection_trace = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.db_inc_retry_interval = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.db_max_retries = 20 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.db_max_retry_interval = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.db_retry_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.max_overflow = 50 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.max_pool_size = 5 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.max_retries = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.mysql_wsrep_sync_wait = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.pool_timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.retry_interval = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.slave_connection = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.sqlite_synchronous = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.synchronous_reader = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] database.use_db_reconnect = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_tracing.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.connection_string = messaging:// {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.es_doc_type = notification {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.es_scroll_size = 10000 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.es_scroll_time = 2m {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.filter_error_trace = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.hmac_keys = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.sentinel_service_name = mymaster {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.socket_timeout = 0.1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.trace_requests = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler.trace_sqlalchemy = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler_jaeger.process_tags = {} {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler_jaeger.service_name_prefix = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] profiler_otlp.service_name_prefix = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.enforce_new_defaults = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.policy_default_rule = default {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.policy_file = policy.yaml {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.group = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.helper_command = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] privsep_osbrick.user = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.group = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.helper_command = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] cinder_sys_admin.user = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.auth_section = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.auth_type = password {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.cafile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.collect_timing = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.send_service_user_token = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.split_loggers = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.tls_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] service_user.tls_min_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.auth_section = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.auth_type = password {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.collect_timing = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.region_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.split_loggers = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.tls_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] glance.tls_min_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.backend_availability_zone = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.chap_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.chap_username = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.disk_geometry = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_client_cert = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_client_cert_key = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_data_namespace = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.driver_use_ssl = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.extra_capabilities = {} {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.filter_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.goodness_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iscsi_target_flags = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iscsi_write_cache = on {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iser_helper = tgtadm {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iser_port = 3260 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_host = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_login = admin {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_mount_options = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_private_key = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_share_path = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_ssh_port = 22 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.num_shell_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.quobyte_volume_url = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.replication_device = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.report_discard_supported = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.reserved_percentage = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87094) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_helper = tgtadm {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_port = 3260 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_protocol = iscsi {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.trace_flags = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.unique_fqdn_network = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.use_chap_auth = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_backend_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Running cmd (subprocess): mount.quobyte {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_clear = zero {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_clear_ionice = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_clear_size = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_reports.file_event_handler = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_reports.log_dir = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.backend_availability_zone = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.backend_host = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.chap_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.chap_username = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.chiscsi_conf = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.disk_geometry = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_client_cert = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_data_namespace = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.driver_use_ssl = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.extra_capabilities = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.filter_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.goodness_function = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iscsi_target_flags = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iscsi_write_cache = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iser_helper = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iser_ip_address = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iser_port = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.iser_target_prefix = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_host = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_login = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_mount_options = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_password = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_private_key = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_share_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_ssh_port = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.num_shell_tries = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nvmet_ns_id = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.nvmet_port_id = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.replication_device = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.report_discard_supported = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.reserved_percentage = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.scst_target_driver = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.storage_protocol = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_helper = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_ip_address = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_port = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_prefix = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_protocol = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.trace_flags = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.unique_fqdn_network = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.use_chap_auth = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_clear = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_clear_ionice = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_clear_size = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] QuobyteHD.volumes_dir = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_notifications.driver = [] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_notifications.retry = -1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] key_manager.fixed_key = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.barbican_api_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.barbican_endpoint = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.barbican_endpoint_type = public {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.barbican_region_name = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.cafile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.collect_timing = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.number_of_retries = 60 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.retry_delay = 1 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack quobyte-client[87099]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.send_service_user_token = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.split_loggers = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.tls_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.tls_min_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.verify_ssl = True {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican.verify_ssl_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack quobyte-client[87099]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.auth_section = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.auth_type = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.cafile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.certfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.collect_timing = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.insecure = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.keyfile = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.split_loggers = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.timeout = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.tls_ciphers = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] barbican_service_user.tls_min_version = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.approle_role_id = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.approle_secret_id = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.auth_method = approle {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.auth_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.kv_mountpoint = secret {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.kv_path = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.kv_version = 2 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.namespace = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.root_token_id = **** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.ssl_ca_crt_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.timeout = 60.0 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.token_file = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.token_role = None {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.use_ssl = False {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:35:30 devstack cinder-volume[86823]: DEBUG oslo_service.backend._eventlet.service [None req-6c0782ed-1a7e-4a76-b59b-2a80bb7d86bd None None] ******************************************************************************** {{(pid=86823) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] CMD "mount.quobyte" returned: 1 in 0.131s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:30 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:30 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:30 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.265s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:30 devstack cinder-volume[87094]: INFO cinder.volume.driver [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:35:30 devstack cinder-volume[87094]: DEBUG cinder.volume.driver [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4082221984863, 'free_capacity_gb': 1775.4082221984863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87094) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_db.sqlalchemy.engines [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87094) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writer thread running {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.db.api [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Building query based on filter {{(pid=87094) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87094) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:31 devstack cinder-volume[87094]: INFO cinder.keymgr.migration [None req-219c66f9-2ea0-44e4-b2b0-84e5164c1ced None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:35:31 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:31 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:31 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.296s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:35:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Driver initialization completed successfully. Sep 25 12:35:31 devstack cinder-volume[87094]: INFO cinder.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Initiating service 3 cleanup Sep 25 12:35:31 devstack cinder-volume[87094]: INFO cinder.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Service 3 cleanup completed. Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.service [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Creating RPC server for service cinder-volume {{(pid=87094) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.service [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87094) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:35:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:35:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:31 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:35:31 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:32 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.412s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd081d6d-710d-4095-be0f-847d34f00fe4 None None] Driver post RPC initialization completed successfully. Sep 25 12:35:40 devstack cinder-volume[86823]: DEBUG dbcounter [-] [86823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86823) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:35:41 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:35:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:35:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:35:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 6 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:35:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:36:47 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:36:47 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:36:47 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.547s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 6 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:36:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Flow 'volume_create_manager' (cc5e359f-c7d3-467c-9447-2a8a60788471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57019ae-8dc8-4ac7-87f6-c5388d531e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57019ae-8dc8-4ac7-87f6-c5388d531e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684810482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f698bd-0516-477a-be6e-980f659e1517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff543823afa34a0a9ea8079b75c7b08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:06Z,use_quota=True,user_id='b6601d9a1fd24493b3dda16ff0331706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da4d1af-0cae-4f52-9550-9db41d4381e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da4d1af-0cae-4f52-9550-9db41d4381e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57d3479-5f50-45ed-b5a5-ebd2c65aa7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57d3479-5f50-45ed-b5a5-ebd2c65aa7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f698bd-0516-477a-be6e-980f659e1517', 'volume_name': 'volume-e3f698bd-0516-477a-be6e-980f659e1517', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ebff5-8322-494d-9ad4-4abff9c49ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ebff5-8322-494d-9ad4-4abff9c49ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822ea0a1-a800-4eca-b86b-c336ac0c33f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Volume e3f698bd-0516-477a-be6e-980f659e1517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f698bd-0516-477a-be6e-980f659e1517', 'volume_size': 1} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1684810482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f698bd-0516-477a-be6e-980f659e1517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff543823afa34a0a9ea8079b75c7b08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:06Z,use_quota=True,user_id='b6601d9a1fd24493b3dda16ff0331706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Creating volume e3f698bd-0516-477a-be6e-980f659e1517 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:37:06 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:37:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:06 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 1073741824 Sep 25 12:37:06 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:07 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 1073741824" returned: 0 in 1.156s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:07 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 Sep 25 12:37:07 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:08 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822ea0a1-a800-4eca-b86b-c336ac0c33f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f698bd-0516-477a-be6e-980f659e1517', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eedf01-67d1-40d7-ac48-dba8a139ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Volume volume-e3f698bd-0516-477a-be6e-980f659e1517 (e3f698bd-0516-477a-be6e-980f659e1517): created successfully Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2eedf01-67d1-40d7-ac48-dba8a139ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Flow 'volume_create_manager' (cc5e359f-c7d3-467c-9447-2a8a60788471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-110b8b38-e551-4d2b-9247-6c7664a06fc0 tempest-VolumesAdminNegativeTest-302682668 None] Created volume successfully. Sep 25 12:37:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Acquiring lock "cinder-e3f698bd-0516-477a-be6e-980f659e1517-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:37:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "cinder-e3f698bd-0516-477a-be6e-980f659e1517-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:37:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Acquiring lock "cinder-quobyte-e3f698bd-0516-477a-be6e-980f659e1517" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:37:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "cinder-quobyte-e3f698bd-0516-477a-be6e-980f659e1517" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:37:10 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoy__mrh0/privsep.sock'] Sep 25 12:37:10 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoy__mrh0/privsep.sock Sep 25 12:37:10 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 12:37:12 devstack cinder-volume[87094]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 12:37:12 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:12 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Spawned new privsep daemon via rootwrap Sep 25 12:37:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Accepted privsep connection to /tmp/tmpoy__mrh0/privsep.sock {{(pid=87094) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 12:37:12 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 12:37:12 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 12:37:12 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 12:37:12 devstack cinder-volume[87094]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88345 Sep 25 12:37:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d320cec3-9d78-4cc6-978e-58131748d37f]: (2,) {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:37:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1111e-e9d1-43a2-95cf-869a202f6ffe]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:37:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:12 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 Sep 25 12:37:12 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:13 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517" returned: 0 in 0.623s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:13 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517 Sep 25 12:37:13 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:13 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3f698bd-0516-477a-be6e-980f659e1517" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "cinder-quobyte-e3f698bd-0516-477a-be6e-980f659e1517" released by "delete_volume" :: held 3.018s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:37:13 devstack cinder-volume[87094]: WARNING cinder.quota [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:37:13 devstack cinder-volume[87094]: WARNING cinder.quota [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Created reservations ['49694b6f-6251-4039-95cb-a6db44115755', '10fa3025-6ec4-42d9-a986-7d57a8507848', '6f99ffc4-032a-4fe7-9d79-d25a15423b8e', '5db7961c-1009-497a-a6f0-b9189211fb1c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:13 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:37:13 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:14 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.528s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:14 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:37:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Deleted volume successfully. Sep 25 12:37:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c2292b8-f4f5-491c-bd39-b9e61d9c688b tempest-VolumesAdminNegativeTest-302682668 None] Lock "cinder-e3f698bd-0516-477a-be6e-980f659e1517-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:37:23 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:37:24 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (4f80e7bf-42a6-43f1-bfdb-78a565281cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b717238-f6d4-43f2-819d-ee0f549ba019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b717238-f6d4-43f2-819d-ee0f549ba019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1977897375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9826a7c6-a8d8-486f-beb7-205fdc969747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:28Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dc0f3e-6805-4f62-8853-8d8e6b1481ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57dc0f3e-6805-4f62-8853-8d8e6b1481ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e3b7a6-8505-4a00-9815-45217b43c35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e3b7a6-8505-4a00-9815-45217b43c35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9826a7c6-a8d8-486f-beb7-205fdc969747', 'volume_name': 'volume-9826a7c6-a8d8-486f-beb7-205fdc969747', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46989b44-84eb-4389-9dfc-74ed14150ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46989b44-84eb-4389-9dfc-74ed14150ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df861e25-253c-41c7-8c31-368a2aa77035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Volume 9826a7c6-a8d8-486f-beb7-205fdc969747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9826a7c6-a8d8-486f-beb7-205fdc969747', 'volume_size': 1} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1977897375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9826a7c6-a8d8-486f-beb7-205fdc969747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:28Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Creating volume 9826a7c6-a8d8-486f-beb7-205fdc969747 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:37:28 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:37:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:28 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 1073741824 Sep 25 12:37:28 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:29 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 1073741824" returned: 0 in 0.679s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:29 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 Sep 25 12:37:29 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:29 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747" returned: 0 in 0.476s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df861e25-253c-41c7-8c31-368a2aa77035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9826a7c6-a8d8-486f-beb7-205fdc969747', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f370f3fe-82e3-4ac9-b176-1f27c551e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Volume volume-9826a7c6-a8d8-486f-beb7-205fdc969747 (9826a7c6-a8d8-486f-beb7-205fdc969747): created successfully Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f370f3fe-82e3-4ac9-b176-1f27c551e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (4f80e7bf-42a6-43f1-bfdb-78a565281cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a611c3d0-52f6-4851-991d-d019f03daa00 tempest-AttachVolumeNegativeTest-1490719959 None] Created volume successfully. Sep 25 12:37:33 devstack cinder-volume[87094]: WARNING py.warnings [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 12:37:33 devstack cinder-volume[87094]: .first() Sep 25 12:37:33 devstack cinder-volume[87094]: Sep 25 12:37:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.073s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-9826a7c6-a8d8-486f-beb7-205fdc969747', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc1e20ff-8365-42b0-bdfd-01a7df28de1a', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:37:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-11f80e94-4384-45b6-8f93-580b55b66416 req-0db2f441-5a96-49ed-a69c-c434ea7423da tempest-AttachVolumeNegativeTest-1490719959 None] attachment_update completed successfully. Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Flow 'volume_create_manager' (01ba0692-6fe4-4a7d-8829-f285f7619f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ae69a3-7284-46c1-ad77-1eea38cac7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ae69a3-7284-46c1-ad77-1eea38cac7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-685765973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aa1730-def4-46b7-b0df-9d6a3085311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4798caf596c4ed2946f1add85622204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:37Z,use_quota=True,user_id='086bc2afdf80403bb3bbc86d2d2758d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fe4f7e-2608-441b-bae4-4e131b197ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fe4f7e-2608-441b-bae4-4e131b197ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd1ad86-2794-43e0-b4e9-35bd7705608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd1ad86-2794-43e0-b4e9-35bd7705608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23aa1730-def4-46b7-b0df-9d6a3085311c', 'volume_name': 'volume-23aa1730-def4-46b7-b0df-9d6a3085311c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ac881-a3fd-4a57-a1fa-ad6a864dd03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ac881-a3fd-4a57-a1fa-ad6a864dd03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11257292-905b-4b74-9a45-21ecf31ec3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Volume 23aa1730-def4-46b7-b0df-9d6a3085311c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23aa1730-def4-46b7-b0df-9d6a3085311c', 'volume_size': 1} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-685765973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aa1730-def4-46b7-b0df-9d6a3085311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4798caf596c4ed2946f1add85622204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:37Z,use_quota=True,user_id='086bc2afdf80403bb3bbc86d2d2758d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Creating volume 23aa1730-def4-46b7-b0df-9d6a3085311c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:37:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:37:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:37 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c 1073741824 Sep 25 12:37:37 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:38 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c 1073741824" returned: 0 in 0.694s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:38 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c Sep 25 12:37:38 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:38 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c" returned: 0 in 0.686s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11257292-905b-4b74-9a45-21ecf31ec3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23aa1730-def4-46b7-b0df-9d6a3085311c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c420816-0dcd-4e32-9585-ee7733ad77ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Volume volume-23aa1730-def4-46b7-b0df-9d6a3085311c (23aa1730-def4-46b7-b0df-9d6a3085311c): created successfully Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c420816-0dcd-4e32-9585-ee7733ad77ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Flow 'volume_create_manager' (01ba0692-6fe4-4a7d-8829-f285f7619f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-34c27b4b-b665-41d3-954a-6a793bc2cdca tempest-ServerActionsTestOtherA-758843073 None] Created volume successfully. Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Flow 'volume_create_manager' (6decece9-64fb-4696-bce0-bbd06722f545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62afde03-5c88-40ad-8cef-cb1861aabf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62afde03-5c88-40ad-8cef-cb1861aabf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-707553182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15441b8-673c-4fb2-a8f4-c090fa9e1527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d09202eef347159817d1572430e779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:40Z,use_quota=True,user_id='8e5418c37bd54ff28ecaa7cfe1b617a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8068439c-9d1b-4f4f-8614-d89fecd7abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8068439c-9d1b-4f4f-8614-d89fecd7abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fc071a-29f7-4d11-8e92-d85369a26998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fc071a-29f7-4d11-8e92-d85369a26998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15441b8-673c-4fb2-a8f4-c090fa9e1527', 'volume_name': 'volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f681446b-e60f-49f9-b075-b14f609daed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f681446b-e60f-49f9-b075-b14f609daed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83991859-1adb-42c7-ac9d-95ef124af3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Volume a15441b8-673c-4fb2-a8f4-c090fa9e1527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527', 'volume_size': 1} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-707553182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15441b8-673c-4fb2-a8f4-c090fa9e1527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d09202eef347159817d1572430e779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:37:40Z,use_quota=True,user_id='8e5418c37bd54ff28ecaa7cfe1b617a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Creating volume a15441b8-673c-4fb2-a8f4-c090fa9e1527 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:37:39 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:37:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:39 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 1073741824 Sep 25 12:37:39 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:40 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 1073741824" returned: 0 in 0.689s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:40 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 Sep 25 12:37:40 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:40 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527" returned: 0 in 0.320s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83991859-1adb-42c7-ac9d-95ef124af3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199388a6-75c2-444e-956c-fe835afbc0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:37:40 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Volume volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 (a15441b8-673c-4fb2-a8f4-c090fa9e1527): created successfully Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199388a6-75c2-444e-956c-fe835afbc0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:37:40 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Flow 'volume_create_manager' (6decece9-64fb-4696-bce0-bbd06722f545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:37:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-23862bb6-51e4-40e2-8322-9c39848c12f3 tempest-DeleteServersTestJSON-713546306 None] Created volume successfully. Sep 25 12:37:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-79808fb7-d064-4069-aafd-0e6d925b0a2a req-12ad2d24-74e8-4921-a4c8-f0795c4467dd tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-79808fb7-d064-4069-aafd-0e6d925b0a2a req-12ad2d24-74e8-4921-a4c8-f0795c4467dd tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-79808fb7-d064-4069-aafd-0e6d925b0a2a req-12ad2d24-74e8-4921-a4c8-f0795c4467dd tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-79808fb7-d064-4069-aafd-0e6d925b0a2a req-12ad2d24-74e8-4921-a4c8-f0795c4467dd tempest-DeleteServersTestJSON-713546306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e49f696-47d6-45c4-befa-b66051c669fb', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:37:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-79808fb7-d064-4069-aafd-0e6d925b0a2a req-12ad2d24-74e8-4921-a4c8-f0795c4467dd tempest-DeleteServersTestJSON-713546306 None] attachment_update completed successfully. Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:47 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:37:47 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:47 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.497s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 8 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:37:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:37:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-e1312fde-0baf-4a7a-a4f0-3df6dd653e11 req-839c21ae-aa5f-4da1-8cb8-7f7e07188e8a tempest-DeleteServersTestJSON-713546306 None] Terminate volume connection completed successfully. Sep 25 12:37:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-e1312fde-0baf-4a7a-a4f0-3df6dd653e11 req-839c21ae-aa5f-4da1-8cb8-7f7e07188e8a tempest-DeleteServersTestJSON-713546306 None] Deleting attachment 3e49f696-47d6-45c4-befa-b66051c669fb. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "cinder-a15441b8-673c-4fb2-a8f4-c090fa9e1527-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "cinder-a15441b8-673c-4fb2-a8f4-c090fa9e1527-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "cinder-quobyte-a15441b8-673c-4fb2-a8f4-c090fa9e1527" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "cinder-quobyte-a15441b8-673c-4fb2-a8f4-c090fa9e1527" acquired by "delete_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c9b18-b6c4-4854-94e6-2d354f4cfef2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:37:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:50 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 Sep 25 12:37:50 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:51 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527" returned: 0 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:51 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527 Sep 25 12:37:51 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:51 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a15441b8-673c-4fb2-a8f4-c090fa9e1527" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "cinder-quobyte-a15441b8-673c-4fb2-a8f4-c090fa9e1527" released by "delete_volume" :: held 0.953s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Created reservations ['975bfd51-ac3d-4a02-9b57-d94c1833331d', '5b4a6a4c-1735-4e7a-88bb-6f6b617c0045', 'edd9bcfb-57a4-4573-885d-38c5dc1b24e4', '141b60c8-08d2-4fd2-a663-2f78e78ad528'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:37:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:51 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:37:51 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:52 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.423s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:52 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:37:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Deleted volume successfully. Sep 25 12:37:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd441a54-a2ad-43d0-8177-d9d407cf17a3 tempest-DeleteServersTestJSON-713546306 None] Lock "cinder-a15441b8-673c-4fb2-a8f4-c090fa9e1527-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:38:01 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=31,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:02 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=20,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Flow 'volume_create_manager' (85fb43c2-822e-4ebd-b622-c5d70d704359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe37077-cad1-4621-9e4b-8ac4a292cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe37077-cad1-4621-9e4b-8ac4a292cf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-870829141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecc0437-f182-4b1a-ab96-1033c42d7c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae221b46e84a4eb39f60b46e3b0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:38:33Z,use_quota=True,user_id='8d0170248d364539a9da4c3134fb379b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0da26-9246-4583-b8d2-cacce181ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e0da26-9246-4583-b8d2-cacce181ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a814efa-7365-4bcc-a42d-58289b44ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a814efa-7365-4bcc-a42d-58289b44ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecc0437-f182-4b1a-ab96-1033c42d7c39', 'volume_name': 'volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68295a-91a3-48c5-bdff-d359a6bdec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee68295a-91a3-48c5-bdff-d359a6bdec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a9b15-60d7-4930-b945-d56194dce3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Volume 7ecc0437-f182-4b1a-ab96-1033c42d7c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39', 'volume_size': 1} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-870829141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecc0437-f182-4b1a-ab96-1033c42d7c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2ae221b46e84a4eb39f60b46e3b0a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:38:33Z,use_quota=True,user_id='8d0170248d364539a9da4c3134fb379b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Creating volume 7ecc0437-f182-4b1a-ab96-1033c42d7c39 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:38:33 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:38:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:33 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 1073741824 Sep 25 12:38:33 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:34 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 1073741824" returned: 0 in 0.729s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:34 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 Sep 25 12:38:34 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:35 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39" returned: 0 in 0.481s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a9b15-60d7-4930-b945-d56194dce3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b217e393-81d0-426e-9733-5426bf5c990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:38:35 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Volume volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 (7ecc0437-f182-4b1a-ab96-1033c42d7c39): created successfully Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b217e393-81d0-426e-9733-5426bf5c990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Flow 'volume_create_manager' (85fb43c2-822e-4ebd-b622-c5d70d704359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:38:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5965daf1-1f31-4b31-9c0c-a320661115a7 tempest-TaggedAttachmentsTest-113848140 None] Created volume successfully. Sep 25 12:38:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b7ec873f-97eb-43e4-bbb0-58ad739088e8 req-7ff3777a-5fee-441c-9450-75baff6c995a tempest-AttachVolumeNegativeTest-1490719959 None] Terminate volume connection completed successfully. Sep 25 12:38:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b7ec873f-97eb-43e4-bbb0-58ad739088e8 req-7ff3777a-5fee-441c-9450-75baff6c995a tempest-AttachVolumeNegativeTest-1490719959 None] Deleting attachment dc1e20ff-8365-42b0-bdfd-01a7df28de1a. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:38:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-751e4e57-584b-4234-8557-ecc4aa4d2304 req-5e3b2bb4-1926-4c10-aafb-3556165726e7 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-751e4e57-584b-4234-8557-ecc4aa4d2304 req-5e3b2bb4-1926-4c10-aafb-3556165726e7 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-751e4e57-584b-4234-8557-ecc4aa4d2304 req-5e3b2bb4-1926-4c10-aafb-3556165726e7 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-751e4e57-584b-4234-8557-ecc4aa4d2304 req-5e3b2bb4-1926-4c10-aafb-3556165726e7 tempest-ServerActionsTestOtherA-758843073 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-23aa1730-def4-46b7-b0df-9d6a3085311c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1444b04-b012-4c29-8a36-6b2082f0e95b', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:38:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-751e4e57-584b-4234-8557-ecc4aa4d2304 req-5e3b2bb4-1926-4c10-aafb-3556165726e7 tempest-ServerActionsTestOtherA-758843073 None] attachment_update completed successfully. Sep 25 12:38:45 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-b5470f8a-4328-4fd8-aac6-9b4b40b5eab5 tempest-ServerActionsTestOtherA-758843073 None] Terminate volume connection completed successfully. Sep 25 12:38:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-b5470f8a-4328-4fd8-aac6-9b4b40b5eab5 tempest-ServerActionsTestOtherA-758843073 None] Deleting attachment e1444b04-b012-4c29-8a36-6b2082f0e95b. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:38:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-cc8a5d7e-cb6a-4461-bdcc-502573918505 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-cc8a5d7e-cb6a-4461-bdcc-502573918505 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-cc8a5d7e-cb6a-4461-bdcc-502573918505 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-cc8a5d7e-cb6a-4461-bdcc-502573918505 tempest-ServerActionsTestOtherA-758843073 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-23aa1730-def4-46b7-b0df-9d6a3085311c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c4b5a4b-5266-4174-a934-6ad9dc4092b8', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:38:46 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b996d7d7-d96b-4ae1-a1f2-2fd7bbbcfc87 req-cc8a5d7e-cb6a-4461-bdcc-502573918505 tempest-ServerActionsTestOtherA-758843073 None] attachment_update completed successfully. Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:47 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:38:47 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:47 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.508s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:56 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=9,cinder:SELECT=16 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:56 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=18,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Flow 'volume_create_manager' (1240b1d9-5f91-479e-8eee-e4c2671ae36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1380f9-a011-47ee-ad0d-a4720108c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1380f9-a011-47ee-ad0d-a4720108c199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1141045208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d6ef6a-10d4-4d83-a6dd-0874cdfa7248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9be79b8d5e74dda81b14fe22a8e3b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:15Z,use_quota=True,user_id='4bfcbd88e25644fa9be697623960d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4e6070-ec5e-4ee5-b035-53d3b847bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4e6070-ec5e-4ee5-b035-53d3b847bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e768ce-c641-4b7c-aa7a-eeddf3593c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e768ce-c641-4b7c-aa7a-eeddf3593c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d6ef6a-10d4-4d83-a6dd-0874cdfa7248', 'volume_name': 'volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57d07cd-549e-456a-89d2-3d57d2bff8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57d07cd-549e-456a-89d2-3d57d2bff8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5f39d-0b93-4f25-bb87-f20bccc8577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Volume 18d6ef6a-10d4-4d83-a6dd-0874cdfa7248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248', 'volume_size': 1} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1141045208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d6ef6a-10d4-4d83-a6dd-0874cdfa7248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9be79b8d5e74dda81b14fe22a8e3b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:15Z,use_quota=True,user_id='4bfcbd88e25644fa9be697623960d22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Creating volume 18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:39:14 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:39:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:14 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 1073741824 Sep 25 12:39:14 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:15 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 1073741824" returned: 0 in 0.654s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:15 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 Sep 25 12:39:15 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:15 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" returned: 0 in 0.322s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5f39d-0b93-4f25-bb87-f20bccc8577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb305f9b-bc87-41e8-b60b-8b3035b62bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Volume volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 (18d6ef6a-10d4-4d83-a6dd-0874cdfa7248): created successfully Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb305f9b-bc87-41e8-b60b-8b3035b62bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Flow 'volume_create_manager' (1240b1d9-5f91-479e-8eee-e4c2671ae36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c2025130-203e-43d9-8ddc-5c90781b4391 tempest-ServerRescueNegativeTestJSON-1614659094 None] Created volume successfully. Sep 25 12:39:25 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:25 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Acquiring lock "cinder-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "cinder-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Acquiring lock "cinder-quobyte-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "cinder-quobyte-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a41aa9-59d8-4553-a207-deb1098934b7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:39:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:29 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 Sep 25 12:39:29 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:30 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" returned: 0 in 0.471s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:30 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248 Sep 25 12:39:30 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:30 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" returned: 0 in 0.322s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "cinder-quobyte-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248" released by "delete_volume" :: held 0.889s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Created reservations ['0bdb81eb-4e03-4f6d-9b68-5cb688b5b1f5', 'be2b22cd-6ecf-4911-b5f3-9e348b5cf081', '751ea4b0-7ccd-4d7d-9460-429a9fc59358', '52250590-6734-47ae-98d5-8424b859d44b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:30 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:39:30 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:31 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.585s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:39:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Deleted volume successfully. Sep 25 12:39:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2d9f8862-5102-4609-9576-3615c88b7f9a tempest-ServerRescueNegativeTestJSON-1614659094 None] Lock "cinder-18d6ef6a-10d4-4d83-a6dd-0874cdfa7248-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:39:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-e9fcde0a-de82-400f-a1a9-facf133d7b1a req-f1cc0d3f-aa13-462f-b65f-fb19b1acee1d tempest-ServerActionsTestOtherA-758843073 None] Terminate volume connection completed successfully. Sep 25 12:39:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-e9fcde0a-de82-400f-a1a9-facf133d7b1a req-f1cc0d3f-aa13-462f-b65f-fb19b1acee1d tempest-ServerActionsTestOtherA-758843073 None] Deleting attachment 8c4b5a4b-5266-4174-a934-6ad9dc4092b8. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Flow 'volume_create_manager' (aa328bb6-9685-474e-9653-b4854721b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb83a06c-f782-42c3-aa13-9cc6f675b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb83a06c-f782-42c3-aa13-9cc6f675b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1711029921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b087dd-6ecb-4d32-b579-fd526dd5bae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4798caf596c4ed2946f1add85622204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:44Z,use_quota=True,user_id='086bc2afdf80403bb3bbc86d2d2758d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec63743b-7a92-4968-83e5-01f284137061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec63743b-7a92-4968-83e5-01f284137061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abcfb67-e343-4de7-ae78-bb67e28bf01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:43 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abcfb67-e343-4de7-ae78-bb67e28bf01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73b087dd-6ecb-4d32-b579-fd526dd5bae7', 'volume_name': 'volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd2d22f-756b-4190-b34a-43fd84bf7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd2d22f-756b-4190-b34a-43fd84bf7a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b844f89d-d8e8-4cfe-96ab-e576e8744cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Trying to clone 73b087dd-6ecb-4d32-b579-fd526dd5bae7 from image d090291b-21f1-4593-a719-dd6e6ea3f284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:39:44 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932cdac-b17b-4fe0-9fd6-aaa5e2861036]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:39:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:44 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD Sep 25 12:39:44 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:45 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 is fetched for user 086bc2afdf80403bb3bbc86d2d2758d8. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d90fe-594b-40cc-8316-fe5453a2222d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:45 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD Sep 25 12:39:45 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:45 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1711029921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b087dd-6ecb-4d32-b579-fd526dd5bae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4798caf596c4ed2946f1add85622204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:44Z,use_quota=True,user_id='086bc2afdf80403bb3bbc86d2d2758d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Creating volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:39:45 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:39:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:45 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1073741824 Sep 25 12:39:45 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:46 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1073741824" returned: 0 in 0.534s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:46 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 Sep 25 12:39:46 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:46 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7" returned: 0 in 0.299s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Attempting download of d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8705ea3-3c30-4da0-8ba3-f0e7cffbdea6]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:39:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:46 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8 Sep 25 12:39:46 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:47 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8" returned: 0 in 0.470s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:47 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:39:47 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:47 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8 Sep 25 12:39:47 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:47 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.307s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:39:47 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8" returned: 1 in 0.406s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_zq9y9sh8' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17783f5-e4f7-4e8f-9b6d-7da9d9a60ffd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:39:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:47 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD Sep 25 12:39:47 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:48 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:48 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] d090291b-21f1-4593-a719-dd6e6ea3f284 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:39:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:48 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 Sep 25 12:39:48 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-0af976bf-5b28-46e4-a19e-27a01413c7b2 req-28a5fe5b-f3db-4b3f-8da2-af4f79c15775 tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-0af976bf-5b28-46e4-a19e-27a01413c7b2 req-28a5fe5b-f3db-4b3f-8da2-af4f79c15775 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-0af976bf-5b28-46e4-a19e-27a01413c7b2 req-28a5fe5b-f3db-4b3f-8da2-af4f79c15775 tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-0af976bf-5b28-46e4-a19e-27a01413c7b2 req-28a5fe5b-f3db-4b3f-8da2-af4f79c15775 tempest-TaggedAttachmentsTest-113848140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbfdb3df-27d8-4433-a2a8-e718e81a1d80', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:39:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-0af976bf-5b28-46e4-a19e-27a01413c7b2 req-28a5fe5b-f3db-4b3f-8da2-af4f79c15775 tempest-TaggedAttachmentsTest-113848140 None] attachment_update completed successfully. Sep 25 12:39:51 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7" returned: 0 in 3.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_dbbn69b0devstack@QuobyteHD, size 112.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:39:51 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Converted 112.00 MB image at 33.57 MB/s Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:51 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1G Sep 25 12:39:51 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:51 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 1G" returned: 0 in 0.496s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Downloaded image d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 for user 086bc2afdf80403bb3bbc86d2d2758d8 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Marking volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Copying metadata from image d090291b-21f1-4593-a719-dd6e6ea3f284 to 73b087dd-6ecb-4d32-b579-fd526dd5bae7. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:39:51 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Creating volume glance metadata for volume 73b087dd-6ecb-4d32-b579-fd526dd5bae7 backed by image d090291b-21f1-4593-a719-dd6e6ea3f284 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:39:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b844f89d-d8e8-4cfe-96ab-e576e8744cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8e8aab-7ce9-4d02-8236-3427fd440c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:52 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Volume volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 (73b087dd-6ecb-4d32-b579-fd526dd5bae7): created successfully Sep 25 12:39:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8e8aab-7ce9-4d02-8236-3427fd440c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Flow 'volume_create_manager' (aa328bb6-9685-474e-9653-b4854721b86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-448fcddc-bcc9-476e-8e9b-b73f1bc4f7ba tempest-ServerActionsTestOtherA-758843073 None] Created volume successfully. Sep 25 12:39:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-011f7b62-7593-4e2b-a198-78875e899f01 req-48b09091-76d6-4d9f-b170-7cf6826c900f tempest-TaggedAttachmentsTest-113848140 None] Terminate volume connection completed successfully. Sep 25 12:39:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-011f7b62-7593-4e2b-a198-78875e899f01 req-48b09091-76d6-4d9f-b170-7cf6826c900f tempest-TaggedAttachmentsTest-113848140 None] Deleting attachment fbfdb3df-27d8-4433-a2a8-e718e81a1d80. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (33f9b03b-c966-4833-87fd-3c0c5fa753c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50694824-b466-43c1-8ac4-bc1f7357f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50694824-b466-43c1-8ac4-bc1f7357f02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1804147063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9054f1-2d71-4578-8f55-596715a59307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:56Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea357052-e942-47ed-ac82-fd75c9ff8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea357052-e942-47ed-ac82-fd75c9ff8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bf67af-8f39-44d7-87c5-374150a675f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bf67af-8f39-44d7-87c5-374150a675f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9054f1-2d71-4578-8f55-596715a59307', 'volume_name': 'volume-0d9054f1-2d71-4578-8f55-596715a59307', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d500f9-05bc-4f6f-92b3-2b08218aa446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d500f9-05bc-4f6f-92b3-2b08218aa446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e822fb97-0247-450d-bf57-b4aea4f665fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:55 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Volume 0d9054f1-2d71-4578-8f55-596715a59307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9054f1-2d71-4578-8f55-596715a59307', 'volume_size': 1} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1804147063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9054f1-2d71-4578-8f55-596715a59307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:56Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Creating volume 0d9054f1-2d71-4578-8f55-596715a59307 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:39:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:56 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 1073741824 Sep 25 12:39:56 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-c2fdb463-d75c-4144-9631-375cb09717c9 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:56 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 1073741824" returned: 0 in 0.736s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:56 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 Sep 25 12:39:56 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:39:57 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-c2fdb463-d75c-4144-9631-375cb09717c9 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.602s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e822fb97-0247-450d-bf57-b4aea4f665fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9054f1-2d71-4578-8f55-596715a59307', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34d77ea-6da7-4798-b8f1-bf6edc4bfb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Volume volume-0d9054f1-2d71-4578-8f55-596715a59307 (0d9054f1-2d71-4578-8f55-596715a59307): created successfully Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34d77ea-6da7-4798-b8f1-bf6edc4bfb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (33f9b03b-c966-4833-87fd-3c0c5fa753c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c3f7a916-1b9a-422f-9ee6-3941560748a9 tempest-AttachVolumeNegativeTest-1490719959 None] Created volume successfully. Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-c2fdb463-d75c-4144-9631-375cb09717c9 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.225s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-c2fdb463-d75c-4144-9631-375cb09717c9 tempest-ServerActionsTestOtherA-758843073 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6047bb52-eec3-4db8-be7c-03c8abbed4fc', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:39:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-c2fdb463-d75c-4144-9631-375cb09717c9 tempest-ServerActionsTestOtherA-758843073 None] attachment_update completed successfully. Sep 25 12:39:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b910b33f-bca8-48bf-8dfa-e59a4b5d4b38 req-2cb58262-fd9d-4fb9-8022-24d47c10bdfc tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b910b33f-bca8-48bf-8dfa-e59a4b5d4b38 req-2cb58262-fd9d-4fb9-8022-24d47c10bdfc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b910b33f-bca8-48bf-8dfa-e59a4b5d4b38 req-2cb58262-fd9d-4fb9-8022-24d47c10bdfc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b910b33f-bca8-48bf-8dfa-e59a4b5d4b38 req-2cb58262-fd9d-4fb9-8022-24d47c10bdfc tempest-AttachVolumeNegativeTest-1490719959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-0d9054f1-2d71-4578-8f55-596715a59307', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4fb1946-4e71-4b16-bb4b-25a8682b1d4c', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:39:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b910b33f-bca8-48bf-8dfa-e59a4b5d4b38 req-2cb58262-fd9d-4fb9-8022-24d47c10bdfc tempest-AttachVolumeNegativeTest-1490719959 None] attachment_update completed successfully. Sep 25 12:40:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-af6dd8f7-68fe-4fe4-996c-2d3c367d15df req-7ba41a34-d321-45db-9f21-b782e0de7c4e tempest-AttachVolumeNegativeTest-1490719959 None] Terminate volume connection completed successfully. Sep 25 12:40:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-af6dd8f7-68fe-4fe4-996c-2d3c367d15df req-7ba41a34-d321-45db-9f21-b782e0de7c4e tempest-AttachVolumeNegativeTest-1490719959 None] Deleting attachment a4fb1946-4e71-4b16-bb4b-25a8682b1d4c. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:40:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-93814ca9-bae9-4ccf-a8e8-f8728d71e455 tempest-ServerActionsTestOtherA-758843073 None] Terminate volume connection completed successfully. Sep 25 12:40:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-9df07ab8-d1eb-4a01-897e-9e882aebfdc5 req-93814ca9-bae9-4ccf-a8e8-f8728d71e455 tempest-ServerActionsTestOtherA-758843073 None] Deleting attachment 6047bb52-eec3-4db8-be7c-03c8abbed4fc. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "cinder-73b087dd-6ecb-4d32-b579-fd526dd5bae7-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-73b087dd-6ecb-4d32-b579-fd526dd5bae7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "cinder-quobyte-73b087dd-6ecb-4d32-b579-fd526dd5bae7" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-quobyte-73b087dd-6ecb-4d32-b579-fd526dd5bae7" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17eb794-2a1b-488a-9105-44c18d8111a6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:11 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 Sep 25 12:40:11 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:11 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7" returned: 0 in 0.767s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:12 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7 Sep 25 12:40:12 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:12 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-73b087dd-6ecb-4d32-b579-fd526dd5bae7" returned: 0 in 0.488s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-quobyte-73b087dd-6ecb-4d32-b579-fd526dd5bae7" released by "delete_volume" :: held 1.334s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG cinder.quota [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Created reservations ['76c75bba-850f-4ad1-823b-ed27dad84d5c', 'f0049a8c-b587-413a-a41d-e8d50d8bec3d', '32acf009-9e33-41b8-8d59-fef7334d846b', '5d0e7c34-d053-4f52-b0ca-306297413f24'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:12 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:40:12 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:13 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.manager [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Deleted volume successfully. Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-f79ec857-a0ea-459a-943b-0d5c587c6155 req-2e1ee7e9-a262-4a56-825b-791539a86e21 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-73b087dd-6ecb-4d32-b579-fd526dd5bae7-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "cinder-23aa1730-def4-46b7-b0df-9d6a3085311c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-23aa1730-def4-46b7-b0df-9d6a3085311c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "cinder-quobyte-23aa1730-def4-46b7-b0df-9d6a3085311c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "cinder-7ecc0437-f182-4b1a-ab96-1033c42d7c39-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-quobyte-23aa1730-def4-46b7-b0df-9d6a3085311c" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "cinder-7ecc0437-f182-4b1a-ab96-1033c42d7c39-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2056a19-7aca-424e-b77e-d85fb46e0911]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "cinder-quobyte-7ecc0437-f182-4b1a-ab96-1033c42d7c39" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "cinder-quobyte-7ecc0437-f182-4b1a-ab96-1033c42d7c39" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16768a-3cfe-4bb9-929b-1dbb73ad8a52]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:13 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c Sep 25 12:40:13 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:13 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 Sep 25 12:40:13 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:14 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c" returned: 0 in 0.632s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:14 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c Sep 25 12:40:14 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:14 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39" returned: 0 in 0.629s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:14 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39 Sep 25 12:40:14 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:14 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-23aa1730-def4-46b7-b0df-9d6a3085311c" returned: 0 in 0.393s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-quobyte-23aa1730-def4-46b7-b0df-9d6a3085311c" released by "delete_volume" :: held 1.124s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Created reservations ['4b8db221-7c29-43c8-9cd3-17a3c4588cb5', '4ab5da00-9c5f-4d01-931f-24dfbf509897', 'ce7e5c2e-c7c2-4bca-a994-d30ea0c55b4b', '47463b1f-a640-4f37-b49a-a8b92c5bbedc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:40:14 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ecc0437-f182-4b1a-ab96-1033c42d7c39" returned: 0 in 0.396s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "cinder-quobyte-7ecc0437-f182-4b1a-ab96-1033c42d7c39" released by "delete_volume" :: held 1.116s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:14 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Created reservations ['6c397dc6-d582-4345-bc06-2a16071446d6', 'b6c46871-7910-4065-b570-9e585274025a', '447d6232-9340-423a-8286-25d3713b9920', '371edfcc-fcfc-41a0-8edc-7e7931accd6b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:40:14 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:40:14 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:15 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:40:15 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:15 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Deleted volume successfully. Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7c4960ee-0436-4ae2-91e0-8080f4e55cc8 tempest-ServerActionsTestOtherA-758843073 None] Lock "cinder-23aa1730-def4-46b7-b0df-9d6a3085311c-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:15 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.459s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Deleted volume successfully. Sep 25 12:40:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-74f4bb2e-08be-4516-a3ec-f3f37e68594c tempest-TaggedAttachmentsTest-113848140 None] Lock "cinder-7ecc0437-f182-4b1a-ab96-1033c42d7c39-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:25 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:40:25 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=53,cinder:SELECT=50,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:47 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:40:47 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:47 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.348s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:40:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (44a7a7a1-d666-4143-aea5-c0974d4251d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25830e2-1b9c-4e3c-8070-53da72f92bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25830e2-1b9c-4e3c-8070-53da72f92bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-843496659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0bca16-7d64-409f-846e-7814bf5a405a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:56Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd73da1-c7f5-4fec-a018-231fdc1aeae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd73da1-c7f5-4fec-a018-231fdc1aeae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46008331-a571-4c8d-a016-da0927df5d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46008331-a571-4c8d-a016-da0927df5d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0bca16-7d64-409f-846e-7814bf5a405a', 'volume_name': 'volume-8c0bca16-7d64-409f-846e-7814bf5a405a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c243bf9-63de-4ec6-8d97-fe922a62dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c243bf9-63de-4ec6-8d97-fe922a62dba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211c8a03-31db-4fc2-8d1d-db8b59bb5483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Volume 8c0bca16-7d64-409f-846e-7814bf5a405a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0bca16-7d64-409f-846e-7814bf5a405a', 'volume_size': 1} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-843496659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0bca16-7d64-409f-846e-7814bf5a405a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:56Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Creating volume 8c0bca16-7d64-409f-846e-7814bf5a405a {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:40:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:40:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:56 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a 1073741824 Sep 25 12:40:56 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:57 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a 1073741824" returned: 0 in 0.845s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:57 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a Sep 25 12:40:57 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:57 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211c8a03-31db-4fc2-8d1d-db8b59bb5483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0bca16-7d64-409f-846e-7814bf5a405a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129125c-ed9f-47a7-90ad-af754aef8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Volume volume-8c0bca16-7d64-409f-846e-7814bf5a405a (8c0bca16-7d64-409f-846e-7814bf5a405a): created successfully Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129125c-ed9f-47a7-90ad-af754aef8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (44a7a7a1-d666-4143-aea5-c0974d4251d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1fc5b2af-461b-4856-9254-55386d42a66d tempest-AttachVolumeTestJSON-1139178665 None] Created volume successfully. Sep 25 12:40:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5f156dba-7c65-43f2-b4e4-db84e1c8d410 req-60420fd4-689b-418b-a299-c8661f53794c tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5f156dba-7c65-43f2-b4e4-db84e1c8d410 req-60420fd4-689b-418b-a299-c8661f53794c tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5f156dba-7c65-43f2-b4e4-db84e1c8d410 req-60420fd4-689b-418b-a299-c8661f53794c tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-5f156dba-7c65-43f2-b4e4-db84e1c8d410 req-60420fd4-689b-418b-a299-c8661f53794c tempest-AttachVolumeTestJSON-1139178665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-8c0bca16-7d64-409f-846e-7814bf5a405a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ec057b6-92fd-4c4a-9986-0f09d322690d', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:40:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-5f156dba-7c65-43f2-b4e4-db84e1c8d410 req-60420fd4-689b-418b-a299-c8661f53794c tempest-AttachVolumeTestJSON-1139178665 None] attachment_update completed successfully. Sep 25 12:41:05 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (a2308d50-bcc7-4a91-bf86-6cce982aecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf28506-113c-436e-99cc-e8cdbf9cb943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf28506-113c-436e-99cc-e8cdbf9cb943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153126705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95e51d7-b3da-4f8f-b4cd-e452b58174fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:06Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c17d847-d1fb-4ace-9017-e7eb8a91fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c17d847-d1fb-4ace-9017-e7eb8a91fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a22975-8a6f-4c7d-9ad8-b81b26b49820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a22975-8a6f-4c7d-9ad8-b81b26b49820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95e51d7-b3da-4f8f-b4cd-e452b58174fb', 'volume_name': 'volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024bb7f8-151b-4768-bade-d96facb3328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024bb7f8-151b-4768-bade-d96facb3328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938efa8-95c4-4364-baad-5015f5a4f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Volume e95e51d7-b3da-4f8f-b4cd-e452b58174fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb', 'volume_size': 1} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153126705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95e51d7-b3da-4f8f-b4cd-e452b58174fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1167ad5da20f4c5888a60410ff41dfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:06Z,use_quota=True,user_id='f9f0e58897ef4fff9fc6f714ec171615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Creating volume e95e51d7-b3da-4f8f-b4cd-e452b58174fb {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:06 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:06 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb 1073741824 Sep 25 12:41:06 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:06 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb 1073741824" returned: 0 in 0.917s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:07 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb Sep 25 12:41:07 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:07 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" returned: 0 in 0.610s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938efa8-95c4-4364-baad-5015f5a4f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c02b9-f735-4c21-b149-32f2079612f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Volume volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb (e95e51d7-b3da-4f8f-b4cd-e452b58174fb): created successfully Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3c02b9-f735-4c21-b149-32f2079612f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Flow 'volume_create_manager' (a2308d50-bcc7-4a91-bf86-6cce982aecea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a99626c0-dac4-43ad-bc40-8212ff9c5a47 tempest-AttachVolumeNegativeTest-1490719959 None] Created volume successfully. Sep 25 12:41:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b6b74f2b-1a0a-4423-b32b-a5be461aa177 req-ff17c801-9655-46f8-8946-3fcb9890ddd2 tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b6b74f2b-1a0a-4423-b32b-a5be461aa177 req-ff17c801-9655-46f8-8946-3fcb9890ddd2 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b6b74f2b-1a0a-4423-b32b-a5be461aa177 req-ff17c801-9655-46f8-8946-3fcb9890ddd2 tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b6b74f2b-1a0a-4423-b32b-a5be461aa177 req-ff17c801-9655-46f8-8946-3fcb9890ddd2 tempest-AttachVolumeNegativeTest-1490719959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29ed85f4-ecfa-4fe0-8943-ebcd339fc49f', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:41:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b6b74f2b-1a0a-4423-b32b-a5be461aa177 req-ff17c801-9655-46f8-8946-3fcb9890ddd2 tempest-AttachVolumeNegativeTest-1490719959 None] attachment_update completed successfully. Sep 25 12:41:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-d1fd31ac-ad79-4bb6-aad7-c25aeb9eb067 req-3854112b-f0ce-4abf-a587-f5231ac5c4d0 tempest-AttachVolumeNegativeTest-1490719959 None] Terminate volume connection completed successfully. Sep 25 12:41:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-d1fd31ac-ad79-4bb6-aad7-c25aeb9eb067 req-3854112b-f0ce-4abf-a587-f5231ac5c4d0 tempest-AttachVolumeNegativeTest-1490719959 None] Deleting attachment 29ed85f4-ecfa-4fe0-8943-ebcd339fc49f. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:41:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:41:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:INSERT=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:41:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-e95e51d7-b3da-4f8f-b4cd-e452b58174fb-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-e95e51d7-b3da-4f8f-b4cd-e452b58174fb-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-quobyte-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:32 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad32b1fd-8556-43a1-b246-14bdc5736980]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:32 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb Sep 25 12:41:32 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:33 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" returned: 0 in 1.125s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:33 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb Sep 25 12:41:33 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:34 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" returned: 0 in 0.892s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-e95e51d7-b3da-4f8f-b4cd-e452b58174fb" released by "delete_volume" :: held 2.139s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Created reservations ['d3d512aa-dd5b-47fe-af0a-0837007c347e', '56fb143b-f515-488c-9d8e-96f2ef2025f8', 'c5897a50-e4ce-4f16-961c-b985a483e635', 'e0f9c30b-9793-413e-bcaa-2227f5f66138'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:34 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:34 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:35 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.561s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:35 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Deleted volume successfully. Sep 25 12:41:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2c43eb66-193e-42e0-8c41-dc0fadafc5ce tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-e95e51d7-b3da-4f8f-b4cd-e452b58174fb-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-0d9054f1-2d71-4578-8f55-596715a59307-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-0d9054f1-2d71-4578-8f55-596715a59307-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-quobyte-0d9054f1-2d71-4578-8f55-596715a59307" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-0d9054f1-2d71-4578-8f55-596715a59307" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee4cf3b-42d4-4fa1-bba5-27737da23a9f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:36 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 Sep 25 12:41:36 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:37 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307" returned: 0 in 0.854s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:37 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307 Sep 25 12:41:37 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:38 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d9054f1-2d71-4578-8f55-596715a59307" returned: 0 in 0.691s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-0d9054f1-2d71-4578-8f55-596715a59307" released by "delete_volume" :: held 1.675s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Created reservations ['74258e4d-56e6-4d27-b34f-c4959f2468d2', '15037cc8-a3a5-4991-ac27-d20b9e82a480', '229a5c1b-44be-4a5d-a7a4-88e9b114732d', '9ccd4e5c-01fd-4ac5-8106-bad050989c3c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:38 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:38 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:39 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.502s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Deleted volume successfully. Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0124d847-ad95-4011-8812-ddbaff13800c tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-0d9054f1-2d71-4578-8f55-596715a59307-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-9826a7c6-a8d8-486f-beb7-205fdc969747-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-9826a7c6-a8d8-486f-beb7-205fdc969747-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "cinder-quobyte-9826a7c6-a8d8-486f-beb7-205fdc969747" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-9826a7c6-a8d8-486f-beb7-205fdc969747" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d0018-e1b7-4779-aa9c-bcef77b72d2c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:39 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 Sep 25 12:41:39 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:40 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747" returned: 0 in 0.622s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:40 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747 Sep 25 12:41:40 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:40 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9826a7c6-a8d8-486f-beb7-205fdc969747" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-quobyte-9826a7c6-a8d8-486f-beb7-205fdc969747" released by "delete_volume" :: held 1.076s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Created reservations ['740b3475-9020-4df9-8200-0d1591c566b8', '88a39e92-b27d-4d2b-8bfa-f4f2506c0a18', '9c77b9e9-f9d9-45fe-a7d1-e4a018aaba16', '38ebeced-e6ec-401c-ac64-e017f4f0c0cb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:40 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:40 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:41 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:41 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:41 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Deleted volume successfully. Sep 25 12:41:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-237b85a8-2a67-464c-85d1-0e699e41cacc tempest-AttachVolumeNegativeTest-1490719959 None] Lock "cinder-9826a7c6-a8d8-486f-beb7-205fdc969747-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:43 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Flow 'volume_create_manager' (72e86e7f-a221-4cea-b8c9-0f93b0254e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64420f94-731b-4a57-954d-82a04a2cc76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64420f94-731b-4a57-954d-82a04a2cc76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-746236138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced62d18-4592-4b2f-8996-f83693355241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecef09b362b445c692fa5cb50b42ce1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:44Z,use_quota=True,user_id='252a98d1e69944ab83da35861f75cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e418dfaa-1474-49a9-a0d9-fb60aa9a4401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e418dfaa-1474-49a9-a0d9-fb60aa9a4401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c66f2fb-7f76-448b-9932-0be3562f8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c66f2fb-7f76-448b-9932-0be3562f8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced62d18-4592-4b2f-8996-f83693355241', 'volume_name': 'volume-ced62d18-4592-4b2f-8996-f83693355241', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c43449-0660-40b4-b0ba-9444dbb0a662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c43449-0660-40b4-b0ba-9444dbb0a662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29a94c1-39d8-405d-8730-0e5e72d1d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Volume ced62d18-4592-4b2f-8996-f83693355241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced62d18-4592-4b2f-8996-f83693355241', 'volume_size': 1} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-746236138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced62d18-4592-4b2f-8996-f83693355241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecef09b362b445c692fa5cb50b42ce1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:44Z,use_quota=True,user_id='252a98d1e69944ab83da35861f75cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Creating volume ced62d18-4592-4b2f-8996-f83693355241 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:44 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:44 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 1073741824 Sep 25 12:41:44 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:44 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 1073741824" returned: 0 in 0.751s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:45 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 Sep 25 12:41:45 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:45 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-a4e61bd2-8e2a-406e-b614-231e8ea16e9d req-4ee9f818-b618-4abe-aee7-ec83d1370025 tempest-AttachVolumeTestJSON-1139178665 None] Terminate volume connection completed successfully. Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-a4e61bd2-8e2a-406e-b614-231e8ea16e9d req-4ee9f818-b618-4abe-aee7-ec83d1370025 tempest-AttachVolumeTestJSON-1139178665 None] Deleting attachment 9ec057b6-92fd-4c4a-9986-0f09d322690d. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:41:45 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241" returned: 0 in 0.602s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29a94c1-39d8-405d-8730-0e5e72d1d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced62d18-4592-4b2f-8996-f83693355241', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36944060-d739-474c-bf9e-4a521eda730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:45 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Volume volume-ced62d18-4592-4b2f-8996-f83693355241 (ced62d18-4592-4b2f-8996-f83693355241): created successfully Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36944060-d739-474c-bf9e-4a521eda730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Flow 'volume_create_manager' (72e86e7f-a221-4cea-b8c9-0f93b0254e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:45 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b3c8a0c0-ef87-4d39-bf98-4809bcea7be2 tempest-ServersNegativeTestJSON-936922596 None] Created volume successfully. Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:47 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:47 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:47 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.409s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:41:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Flow 'volume_create_manager' (652af1c0-1a0c-4e8c-9455-8f40fed332ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c205e6a6-702a-472e-9cf3-84621ed2c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c205e6a6-702a-472e-9cf3-84621ed2c85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-638192279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a91891-5d2a-45a8-9229-004677f5aec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecef09b362b445c692fa5cb50b42ce1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:49Z,use_quota=True,user_id='252a98d1e69944ab83da35861f75cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5202d1-75a2-485f-9f49-2cecd9f0377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5202d1-75a2-485f-9f49-2cecd9f0377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a1b2a-9270-49da-a80c-f5a04b8deef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a1b2a-9270-49da-a80c-f5a04b8deef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a91891-5d2a-45a8-9229-004677f5aec5', 'volume_name': 'volume-86a91891-5d2a-45a8-9229-004677f5aec5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae93ba6-090f-463c-9f4f-d0732f163c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae93ba6-090f-463c-9f4f-d0732f163c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8646b7-da10-409b-b0d0-727b88f56714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Volume 86a91891-5d2a-45a8-9229-004677f5aec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a91891-5d2a-45a8-9229-004677f5aec5', 'volume_size': 1} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-638192279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a91891-5d2a-45a8-9229-004677f5aec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecef09b362b445c692fa5cb50b42ce1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:49Z,use_quota=True,user_id='252a98d1e69944ab83da35861f75cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Creating volume 86a91891-5d2a-45a8-9229-004677f5aec5 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:49 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:41:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:49 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 1073741824 Sep 25 12:41:49 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:50 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 1073741824" returned: 0 in 0.962s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:50 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 Sep 25 12:41:50 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:50 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5" returned: 0 in 0.347s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8646b7-da10-409b-b0d0-727b88f56714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a91891-5d2a-45a8-9229-004677f5aec5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e87e4e4-2063-41aa-80ff-421dcc992d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Volume volume-86a91891-5d2a-45a8-9229-004677f5aec5 (86a91891-5d2a-45a8-9229-004677f5aec5): created successfully Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e87e4e4-2063-41aa-80ff-421dcc992d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Flow 'volume_create_manager' (652af1c0-1a0c-4e8c-9455-8f40fed332ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7090c256-d4e8-448f-8ca6-c286c002e372 tempest-ServersNegativeTestJSON-936922596 None] Created volume successfully. Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "cinder-86a91891-5d2a-45a8-9229-004677f5aec5-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-86a91891-5d2a-45a8-9229-004677f5aec5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "cinder-quobyte-86a91891-5d2a-45a8-9229-004677f5aec5" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-quobyte-86a91891-5d2a-45a8-9229-004677f5aec5" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ef51e6-9dbc-47b4-b7ff-47142d402871]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:52 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 Sep 25 12:41:52 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:53 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5" returned: 0 in 0.641s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:53 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5 Sep 25 12:41:53 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:53 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-86a91891-5d2a-45a8-9229-004677f5aec5" returned: 0 in 0.382s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-quobyte-86a91891-5d2a-45a8-9229-004677f5aec5" released by "delete_volume" :: held 1.110s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Created reservations ['91573676-e235-4ef0-9928-deeae36b5693', 'b07ed74e-91d6-4d64-80fb-3edf4fe7cc8b', '6a312424-d4ce-400e-9ae5-1a0355a23198', '1a0acab4-74ef-4e93-af76-344564eb9100'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:53 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:53 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:54 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.504s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Deleted volume successfully. Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6d99d6d-2ddc-415f-89a5-6e6e9caa52d7 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-86a91891-5d2a-45a8-9229-004677f5aec5-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "cinder-ced62d18-4592-4b2f-8996-f83693355241-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-ced62d18-4592-4b2f-8996-f83693355241-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "cinder-quobyte-ced62d18-4592-4b2f-8996-f83693355241" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-quobyte-ced62d18-4592-4b2f-8996-f83693355241" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef00e1-68ba-497c-a3a5-aff4e1d5c257]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:55 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 Sep 25 12:41:55 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:55 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241" returned: 0 in 0.517s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:55 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241 Sep 25 12:41:55 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:55 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ced62d18-4592-4b2f-8996-f83693355241" returned: 0 in 0.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-quobyte-ced62d18-4592-4b2f-8996-f83693355241" released by "delete_volume" :: held 1.048s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Created reservations ['0add4f4b-b430-47a5-86d2-8fc55ca866fd', '5e1822da-54ad-4762-8a90-85d04b7560c8', '082a9e08-251b-4085-8bc0-a3dea968917a', '05dc54bf-c47a-4796-b66b-c035eb7c1e00'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:56 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:41:56 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:56 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Flow 'volume_create_manager' (efa97b6d-6bc1-4d8e-8d72-dea2383e8f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a938e5f-0727-49ee-80e0-5d7a66f5b608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.534s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Deleted volume successfully. Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a938e5f-0727-49ee-80e0-5d7a66f5b608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-420429050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe6ba9b-40f3-476d-a026-1b372b8b97b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35701a0499d44576ab3cb6539db982e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:57Z,use_quota=True,user_id='c259ee8dda6c4fd38cc06844efeb319b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6ae591-3684-46b0-a663-07ddbb44fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6ae591-3684-46b0-a663-07ddbb44fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be65f3-0d2e-41c9-9a43-7c5a3698b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36be65f3-0d2e-41c9-9a43-7c5a3698b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe6ba9b-40f3-476d-a026-1b372b8b97b4', 'volume_name': 'volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddde1f3-4001-468e-bbf7-5594453214d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddde1f3-4001-468e-bbf7-5594453214d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfd710f-defe-4a9d-b2ff-98b2f9687144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Volume abe6ba9b-40f3-476d-a026-1b372b8b97b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4', 'volume_size': 1} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-420429050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe6ba9b-40f3-476d-a026-1b372b8b97b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35701a0499d44576ab3cb6539db982e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:57Z,use_quota=True,user_id='c259ee8dda6c4fd38cc06844efeb319b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Creating volume abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:41:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:57 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 1073741824 Sep 25 12:41:57 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebdae719-f419-41fe-a5e9-7d368d459e36 tempest-ServersNegativeTestJSON-936922596 None] Lock "cinder-ced62d18-4592-4b2f-8996-f83693355241-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:57 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 1073741824" returned: 0 in 0.882s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:58 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 Sep 25 12:41:58 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:58 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4" returned: 0 in 0.362s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfd710f-defe-4a9d-b2ff-98b2f9687144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7905f3-26fd-4042-9fe6-90b6aefec1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Volume volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 (abe6ba9b-40f3-476d-a026-1b372b8b97b4): created successfully Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7905f3-26fd-4042-9fe6-90b6aefec1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Flow 'volume_create_manager' (efa97b6d-6bc1-4d8e-8d72-dea2383e8f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-c06dd223-dfa9-4fa2-bbe8-50eef8df4375 req-23bbdd3c-62d6-4530-8aa9-92d6e5ed0503 tempest-VolumesSnapshotsTestJSON-901218324 None] Created volume successfully. Sep 25 12:41:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Creating offline snapshot bc6338bc-3415-4a37-a6db-cc55f8620f53 of volume abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:41:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb55801-4988-41b1-95dc-f7e4600dd658]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:00 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 Sep 25 12:42:00 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Flow 'volume_create_manager' (ffa361d8-5702-463e-b4d3-ae67b208e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0563ea3-e165-47e3-8a3e-33db8697c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0563ea3-e165-47e3-8a3e-33db8697c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1728718419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3866318-3493-47d3-8d9e-c0a375ef49a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b6230ffa9845fc90464c00f818e37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:00Z,use_quota=True,user_id='33caea42b7094be6bc97978e9f2d8ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b25951f-2feb-4993-ad7d-1f805b6bf578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b25951f-2feb-4993-ad7d-1f805b6bf578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3d2784-2946-473f-89be-ba50567ef30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3d2784-2946-473f-89be-ba50567ef30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3866318-3493-47d3-8d9e-c0a375ef49a3', 'volume_name': 'volume-f3866318-3493-47d3-8d9e-c0a375ef49a3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4671430-0dfe-46ba-9119-c39e14c59cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4671430-0dfe-46ba-9119-c39e14c59cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652fc554-acde-4a7e-b680-d22b0dd3b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:00 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Volume f3866318-3493-47d3-8d9e-c0a375ef49a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3866318-3493-47d3-8d9e-c0a375ef49a3', 'volume_size': 1} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:00 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4" returned: 0 in 0.665s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:00 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 1G Sep 25 12:42:00 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:01 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 1G" returned: 0 in 0.728s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:01 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 Sep 25 12:42:01 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:01 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53" returned: 0 in 0.452s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:01 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 is being set with open permissions: ugo+rw Sep 25 12:42:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:01 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 Sep 25 12:42:01 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:02 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53" returned: 0 in 0.364s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:02 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info Sep 25 12:42:02 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:02 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:02 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info is being set with open permissions: ugo+rw Sep 25 12:42:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:02 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info Sep 25 12:42:02 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:03 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.info" returned: 0 in 0.394s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1728718419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3866318-3493-47d3-8d9e-c0a375ef49a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b6230ffa9845fc90464c00f818e37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:00Z,use_quota=True,user_id='33caea42b7094be6bc97978e9f2d8ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Creating volume f3866318-3493-47d3-8d9e-c0a375ef49a3 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:03 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:03 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 1073741824 Sep 25 12:42:03 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-fdf1c727-9287-4cd5-b71d-fffc09209212 req-8da44f27-d99c-4e44-9273-4ed2c58907ac tempest-VolumesSnapshotsTestJSON-901218324 None] Create snapshot completed successfully Sep 25 12:42:03 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 1073741824" returned: 0 in 0.770s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "cinder-bc6338bc-3415-4a37-a6db-cc55f8620f53-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:04 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 Sep 25 12:42:04 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-bc6338bc-3415-4a37-a6db-cc55f8620f53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "cinder-quobyte-bc6338bc-3415-4a37-a6db-cc55f8620f53" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-bc6338bc-3415-4a37-a6db-cc55f8620f53" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Deleting offline snapshot bc6338bc-3415-4a37-a6db-cc55f8620f53 of volume abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] snapshot_file for this snap is: volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[11949cb7-5532-44ed-81b9-8e3e08ce8a06]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:04 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 Sep 25 12:42:04 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:04 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3" returned: 0 in 0.484s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652fc554-acde-4a7e-b680-d22b0dd3b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3866318-3493-47d3-8d9e-c0a375ef49a3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc496e9-7bcd-4608-83fb-fa360dfb6099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:04 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Volume volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 (f3866318-3493-47d3-8d9e-c0a375ef49a3): created successfully Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc496e9-7bcd-4608-83fb-fa360dfb6099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Flow 'volume_create_manager' (ffa361d8-5702-463e-b4d3-ae67b208e48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-eab32f73-cd5f-474c-a6e5-f00bf4f917d9 tempest-AttachVolumeShelveTestJSON-1204317678 None] Created volume successfully. Sep 25 12:42:04 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53" returned: 0 in 0.649s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc69432e-d806-4edc-9a0d-9c2f1427349e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:05 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 Sep 25 12:42:05 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:05 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4" returned: 0 in 0.766s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:05 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 Sep 25 12:42:05 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:06 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53" returned: 0 in 0.535s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:06 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53 Sep 25 12:42:06 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:06 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4.bc6338bc-3415-4a37-a6db-cc55f8620f53" returned: 0 in 0.432s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-bc6338bc-3415-4a37-a6db-cc55f8620f53" released by "_delete_snapshot" :: held 2.579s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" released by "delete_snapshot" :: held 2.639s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:06 devstack cinder-volume[87094]: WARNING cinder.quota [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:42:06 devstack cinder-volume[87094]: DEBUG cinder.quota [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Created reservations ['532ecc8b-1514-412b-90f7-c948f6639048', '92b12b6b-3869-4aec-88bd-d766b3ab259f', '83afc75d-dd07-4046-93d4-9ad1fa9a750d', '802a422c-9a1c-4ab4-9e99-e01658d4b2b0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Delete snapshot completed successfully. Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-aef4e931-583e-41cb-b92b-70ace2aaf0f0 req-3242767e-9743-4065-b943-be5d99bc8fc4 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-bc6338bc-3415-4a37-a6db-cc55f8620f53-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "cinder-abe6ba9b-40f3-476d-a026-1b372b8b97b4-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-abe6ba9b-40f3-476d-a026-1b372b8b97b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c4fd5-88f3-4884-b3a7-97249d58711f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:07 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 Sep 25 12:42:07 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:08 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4" returned: 0 in 0.659s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:08 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4 Sep 25 12:42:08 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:08 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-abe6ba9b-40f3-476d-a026-1b372b8b97b4" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-quobyte-abe6ba9b-40f3-476d-a026-1b372b8b97b4" released by "delete_volume" :: held 1.220s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG cinder.quota [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Created reservations ['310cfa76-d233-4e98-a084-458c4a42f04f', 'b65c108e-ecfa-4c8e-b509-4288203c1e9b', 'fd2c5004-2ea5-4b9c-b4c0-f03488697fda', '985b31b0-1f1d-4366-983c-ae0f01d1d19a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:09 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:09 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:09 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.332s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG cinder.manager [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Deleted volume successfully. Sep 25 12:42:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-08733a22-f535-4097-9e8d-d43e3e45ff3d req-4cddb2a6-6a5c-4aeb-a4ce-e50b46b68444 tempest-VolumesSnapshotsTestJSON-901218324 None] Lock "cinder-abe6ba9b-40f3-476d-a026-1b372b8b97b4-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:14 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (2e05867d-6177-40ee-8a29-2d08fad56d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1893ceb5-3f02-403c-b811-8e63073f004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1893ceb5-3f02-403c-b811-8e63073f004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-978208154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f803054-db9c-442e-83a3-cc9ae00c89c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:15Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e85c43-5bd3-42d2-b098-d3909a37f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e85c43-5bd3-42d2-b098-d3909a37f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418e5196-7cee-4919-996e-1ee411a49a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418e5196-7cee-4919-996e-1ee411a49a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f803054-db9c-442e-83a3-cc9ae00c89c8', 'volume_name': 'volume-0f803054-db9c-442e-83a3-cc9ae00c89c8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac0f132-2ceb-4f68-8da8-49d8752da6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac0f132-2ceb-4f68-8da8-49d8752da6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078d2f1-fbb4-4fed-888b-d7296abbd619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Volume 0f803054-db9c-442e-83a3-cc9ae00c89c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f803054-db9c-442e-83a3-cc9ae00c89c8', 'volume_size': 1} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-978208154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f803054-db9c-442e-83a3-cc9ae00c89c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:15Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Creating volume 0f803054-db9c-442e-83a3-cc9ae00c89c8 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:42:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:15 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 1073741824 Sep 25 12:42:15 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:16 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 1073741824" returned: 0 in 0.897s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:16 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 Sep 25 12:42:16 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:16 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8" returned: 0 in 0.353s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f078d2f1-fbb4-4fed-888b-d7296abbd619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f803054-db9c-442e-83a3-cc9ae00c89c8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871ac63-9f17-4166-ae7c-a223049c27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Volume volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 (0f803054-db9c-442e-83a3-cc9ae00c89c8): created successfully Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871ac63-9f17-4166-ae7c-a223049c27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (2e05867d-6177-40ee-8a29-2d08fad56d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72edac72-8dce-4130-bd13-664f8b9e6a74 tempest-VolumesTestJSON-1820971148 None] Created volume successfully. Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-5f8fa473-03a1-4add-be3f-c46d11889ac8 req-21987e3e-81b3-4131-a2e5-074d97d2d48a tempest-AttachVolumeShelveTestJSON-1204317678 None] No connector for attachment 7f55e90a-a7af-4fad-83c2-57b00ffeb2ab; skipping storage backend terminate_connection call. {{(pid=87094) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-5f8fa473-03a1-4add-be3f-c46d11889ac8 req-21987e3e-81b3-4131-a2e5-074d97d2d48a tempest-AttachVolumeShelveTestJSON-1204317678 None] Deleting attachment 7f55e90a-a7af-4fad-83c2-57b00ffeb2ab. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (c381c41d-e160-4116-8f9c-b08d00a59b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624a5f6-abc2-4974-9ece-5cbc84ba958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624a5f6-abc2-4974-9ece-5cbc84ba958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1396793061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114d3afa-2aac-414a-a3f4-6f075b4883c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:18Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22997e97-e6e4-43a7-9ccd-d374612f7e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22997e97-e6e4-43a7-9ccd-d374612f7e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed68a3e-f2a7-444c-a5cc-168820c37270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed68a3e-f2a7-444c-a5cc-168820c37270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114d3afa-2aac-414a-a3f4-6f075b4883c6', 'volume_name': 'volume-114d3afa-2aac-414a-a3f4-6f075b4883c6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df99014f-b5d8-4803-9e68-9930759aa9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df99014f-b5d8-4803-9e68-9930759aa9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aab78f-7095-4b5f-af9a-c498795dc50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Volume 114d3afa-2aac-414a-a3f4-6f075b4883c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114d3afa-2aac-414a-a3f4-6f075b4883c6', 'volume_size': 1} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1396793061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114d3afa-2aac-414a-a3f4-6f075b4883c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:18Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Creating volume 114d3afa-2aac-414a-a3f4-6f075b4883c6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:17 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:42:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:17 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 1073741824 Sep 25 12:42:17 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:18 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 1073741824" returned: 0 in 0.776s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:18 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 Sep 25 12:42:18 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:19 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6" returned: 0 in 0.452s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90aab78f-7095-4b5f-af9a-c498795dc50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114d3afa-2aac-414a-a3f4-6f075b4883c6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d98d718-052f-4409-8606-7359d22dd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Volume volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 (114d3afa-2aac-414a-a3f4-6f075b4883c6): created successfully Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d98d718-052f-4409-8606-7359d22dd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (c381c41d-e160-4116-8f9c-b08d00a59b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ed5da797-623e-4d36-8918-d06b2a110cb6 tempest-VolumesTestJSON-1820971148 None] Created volume successfully. Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (f718c5eb-e104-4a3a-b6a9-8099f14e9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1facd0-c095-4492-8585-dde302d903fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1facd0-c095-4492-8585-dde302d903fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1513028156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7484150c-5544-4615-b1b1-d56847e26d37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:21Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf852156-3025-4189-8110-4e51a89cd4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf852156-3025-4189-8110-4e51a89cd4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2d623-c605-4d15-b091-595cf5dcaaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb2d623-c605-4d15-b091-595cf5dcaaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7484150c-5544-4615-b1b1-d56847e26d37', 'volume_name': 'volume-7484150c-5544-4615-b1b1-d56847e26d37', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365f8c9f-7d69-4dcf-8197-da89a3ce9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365f8c9f-7d69-4dcf-8197-da89a3ce9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d0417f-2fe0-431b-a854-145f8317e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Volume 7484150c-5544-4615-b1b1-d56847e26d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7484150c-5544-4615-b1b1-d56847e26d37', 'volume_size': 1} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1513028156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7484150c-5544-4615-b1b1-d56847e26d37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a486c20854284dcdacbfa3a725eec0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:21Z,use_quota=True,user_id='92b830207e3d4b8e8e9ce70e3b5747af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Creating volume 7484150c-5544-4615-b1b1-d56847e26d37 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:21 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:42:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:21 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 1073741824 Sep 25 12:42:21 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:22 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 1073741824" returned: 0 in 0.853s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:22 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 Sep 25 12:42:22 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:22 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d0417f-2fe0-431b-a854-145f8317e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7484150c-5544-4615-b1b1-d56847e26d37', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8298105f-1300-445d-827f-bc0dffaf2d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Volume volume-7484150c-5544-4615-b1b1-d56847e26d37 (7484150c-5544-4615-b1b1-d56847e26d37): created successfully Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8298105f-1300-445d-827f-bc0dffaf2d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Flow 'volume_create_manager' (f718c5eb-e104-4a3a-b6a9-8099f14e9ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-04ce7acf-a698-4321-aaac-5d389d4f778a tempest-VolumesTestJSON-1820971148 None] Created volume successfully. Sep 25 12:42:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db537231-70e2-4ff1-9495-5dd240220e01 tempest-GroupsV314Test-696971886 None] Group tempest-GroupsV314Test-Group-1047210280: creating Sep 25 12:42:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db537231-70e2-4ff1-9495-5dd240220e01 tempest-GroupsV314Test-696971886 None] Group tempest-GroupsV314Test-Group-1047210280: created successfully Sep 25 12:42:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db537231-70e2-4ff1-9495-5dd240220e01 tempest-GroupsV314Test-696971886 None] Create group completed successfully. Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-7484150c-5544-4615-b1b1-d56847e26d37-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-7484150c-5544-4615-b1b1-d56847e26d37-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-quobyte-7484150c-5544-4615-b1b1-d56847e26d37" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-7484150c-5544-4615-b1b1-d56847e26d37" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017338e-0001-4b7c-a7c5-a40cfdd9cc06]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:25 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 Sep 25 12:42:25 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:25 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37" returned: 0 in 0.585s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:25 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37 Sep 25 12:42:25 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Flow 'volume_create_manager' (34ef5e51-d725-47a0-accd-b1a5809f6a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2b331d-f66b-40b8-a359-a50a563c3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2b331d-f66b-40b8-a359-a50a563c3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839164510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2af4b1a5-1230-425f-8871-1c09e534dd40,host='devstack@QuobyteHD#QuobyteHD',id=921fa5b1-1d61-4229-8a39-d8794d231f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23d8c95f7894ee3855c2f7e83db7aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:26Z,use_quota=True,user_id='89420c039ae34cdb96c0ab3dd3adab28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0bd94c6-d8f3-45f9-9e69-5313cf31b2cc),volume_type_id=f0bd94c6-d8f3-45f9-9e69-5313cf31b2cc)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab57ca4-cc05-4bd5-99fd-809a9d278f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab57ca4-cc05-4bd5-99fd-809a9d278f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8362bc8-7627-401e-99f4-1862b281fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8362bc8-7627-401e-99f4-1862b281fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921fa5b1-1d61-4229-8a39-d8794d231f4c', 'volume_name': 'volume-921fa5b1-1d61-4229-8a39-d8794d231f4c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81d8d77-1ad6-4b31-9630-c3f51a86b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81d8d77-1ad6-4b31-9630-c3f51a86b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba24690d-503a-455c-a6d2-22c84e2b37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Volume 921fa5b1-1d61-4229-8a39-d8794d231f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921fa5b1-1d61-4229-8a39-d8794d231f4c', 'volume_size': 1} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2af4b1a5-1230-425f-8871-1c09e534dd40,created_at=2026-09-25T10:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839164510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2af4b1a5-1230-425f-8871-1c09e534dd40,host='devstack@QuobyteHD#QuobyteHD',id=921fa5b1-1d61-4229-8a39-d8794d231f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23d8c95f7894ee3855c2f7e83db7aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:26Z,use_quota=True,user_id='89420c039ae34cdb96c0ab3dd3adab28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0bd94c6-d8f3-45f9-9e69-5313cf31b2cc),volume_type_id=f0bd94c6-d8f3-45f9-9e69-5313cf31b2cc)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Creating volume 921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:26 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:26 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c 1073741824 Sep 25 12:42:26 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:26 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7484150c-5544-4615-b1b1-d56847e26d37" returned: 0 in 0.627s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-7484150c-5544-4615-b1b1-d56847e26d37" released by "delete_volume" :: held 1.286s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Created reservations ['1553ecf7-b3bd-4417-af90-3e5654de4554', 'ec1f6669-a2de-418e-b627-4660bce67c47', '57f9b564-a3a4-49f8-aa08-60a1e8e34ce8', 'b4470b64-b1c2-435b-b883-2c4e2f2a066f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=64,cinder:UPDATE=85,cinder:INSERT=18,cinder:DELETE=7 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:26 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:26 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:27 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c 1073741824" returned: 0 in 1.009s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:27 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.635s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:27 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Deleted volume successfully. Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fa405ab9-b3c8-453f-aec4-6fb3dd4c7b27 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-7484150c-5544-4615-b1b1-d56847e26d37-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:27 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:27 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-114d3afa-2aac-414a-a3f4-6f075b4883c6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-114d3afa-2aac-414a-a3f4-6f075b4883c6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-quobyte-114d3afa-2aac-414a-a3f4-6f075b4883c6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-114d3afa-2aac-414a-a3f4-6f075b4883c6" acquired by "delete_volume" :: waited 0.051s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd05c51-04fd-40a9-a36a-3e0d824aa6fb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:27 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 0.483s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:42:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba24690d-503a-455c-a6d2-22c84e2b37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921fa5b1-1d61-4229-8a39-d8794d231f4c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a9082c-e6ea-44a4-8058-e33d6f804dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Volume volume-921fa5b1-1d61-4229-8a39-d8794d231f4c (921fa5b1-1d61-4229-8a39-d8794d231f4c): created successfully Sep 25 12:42:28 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 Sep 25 12:42:28 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a9082c-e6ea-44a4-8058-e33d6f804dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Flow 'volume_create_manager' (34ef5e51-d725-47a0-accd-b1a5809f6a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c315cd32-b848-495e-95bf-51b90ec9a77e tempest-GroupsV314Test-696971886 None] Created volume successfully. Sep 25 12:42:28 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6" returned: 0 in 0.514s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:28 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6 Sep 25 12:42:28 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:28 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-114d3afa-2aac-414a-a3f4-6f075b4883c6" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-114d3afa-2aac-414a-a3f4-6f075b4883c6" released by "delete_volume" :: held 0.947s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Created reservations ['c53988d9-6242-420f-bf1d-938d8b22f13a', 'c2f38a30-f359-4e1d-991f-868efba4a783', 'f9867a1e-2219-4091-a12d-c1ee5727b170', '8dc31d5d-e770-4d53-a517-a8dfc3336519'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:29 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:29 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:29 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.484s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Deleted volume successfully. Sep 25 12:42:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acb0770b-6734-43ec-a0fa-38afa457a5a6 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-114d3afa-2aac-414a-a3f4-6f075b4883c6-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-0f803054-db9c-442e-83a3-cc9ae00c89c8-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-0f803054-db9c-442e-83a3-cc9ae00c89c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "cinder-quobyte-0f803054-db9c-442e-83a3-cc9ae00c89c8" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:30 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Cloning volume 921fa5b1-1d61-4229-8a39-d8794d231f4c to volume 33cd8bb5-c96e-4130-8631-2380b1fad1a9 Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-0f803054-db9c-442e-83a3-cc9ae00c89c8" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9e1b43-5028-4424-85ce-42f0e15119ef]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Creating offline snapshot 4cd01c49-8482-4809-8200-df4e2bb282a8 of volume 921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c0c3a-c0a6-4d07-960d-1baadf6f5ce5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:30 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 Sep 25 12:42:30 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:30 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:30 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:30 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8" returned: 0 in 0.603s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:31 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8 Sep 25 12:42:31 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:31 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 0.597s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:31 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 1G Sep 25 12:42:31 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:31 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f803054-db9c-442e-83a3-cc9ae00c89c8" returned: 0 in 0.497s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-quobyte-0f803054-db9c-442e-83a3-cc9ae00c89c8" released by "delete_volume" :: held 1.188s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Created reservations ['b8455648-73dd-44a5-9537-642dae3cbd7d', 'bee58249-fddd-4e8b-b059-742aaac9e431', '82c96808-a3fd-4fe2-8256-5fe653ca0573', '86755ad7-b1bd-4bf6-aabe-78829ff2bcbc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:31 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:31 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:31 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 1G" returned: 0 in 0.842s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921fa5b1-1d61-4229-8a39-d8794d231f4c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:31 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921fa5b1-1d61-4229-8a39-d8794d231f4c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:31 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:32 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.482s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Deleted volume successfully. Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7a18380f-beba-4878-a9e8-b0b3aafc82f9 tempest-VolumesTestJSON-1820971148 None] Lock "cinder-0f803054-db9c-442e-83a3-cc9ae00c89c8-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:32 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921fa5b1-1d61-4229-8a39-d8794d231f4c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.507s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:32 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:32 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:32 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:32 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.438s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:32 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info Sep 25 12:42:32 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:33 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info" returned: 0 in 0.593s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:33 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:42:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:33 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info Sep 25 12:42:33 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:33 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.info" returned: 0 in 0.521s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Acquiring lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] snapshot: 4cd01c49-8482-4809-8200-df4e2bb282a8, volume: 33cd8bb5-c96e-4130-8631-2380b1fad1a9, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed64ac-7190-4d19-8277-2fbb34e32f8b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:34 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:34 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:35 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.851s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921fa5b1-1d61-4229-8a39-d8794d231f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec48ce6-bcb7-4119-bec6-208b2dc37c9d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:35 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:35 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:35 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 0.847s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:42:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:36 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 Sep 25 12:42:36 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=16,cinder:DELETE=4,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=26,cinder:SELECT=17,cinder:INSERT=7 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-587ab044-48d0-4fc8-9700-68e982a73b43 tempest-BackendsCapabilitiesAdminTestsJSON-1486736300 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4082221984863, 'free_capacity_gb': 1775.4082221984863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87094) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 12:42:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-623ad89c-9019-4d4e-ae41-b5fa513e6828 tempest-BackendsCapabilitiesAdminTestsJSON-1486736300 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4082221984863, 'free_capacity_gb': 1775.4082221984863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87094) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:47 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:47 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:48 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 1.230s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:48 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:42:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:42:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:42:49 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9" returned: 0 in 13.211s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c, size 1024.00 MB, duration 13.21 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:42:49 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Converted 1024.00 MB image at 77.50 MB/s Sep 25 12:42:49 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:49 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 Sep 25 12:42:49 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:49 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" released by "_copy_volume_from_snapshot" :: held 15.616s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Acquiring lock "cinder-quobyte-4cd01c49-8482-4809-8200-df4e2bb282a8" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-4cd01c49-8482-4809-8200-df4e2bb282a8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Deleting offline snapshot 4cd01c49-8482-4809-8200-df4e2bb282a8 of volume 921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] snapshot_file for this snap is: volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae96d3-3d56-43dd-8e1e-ce6534113c3f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:50 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:50 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:50 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.624s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921fa5b1-1d61-4229-8a39-d8794d231f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:42:50 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638da05-d9cd-4113-ad77-e68faaf22c7b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:50 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:50 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:51 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 1.079s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:51 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:51 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:52 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.738s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:52 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8 Sep 25 12:42:52 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:52 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c.4cd01c49-8482-4809-8200-df4e2bb282a8" returned: 0 in 0.489s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-4cd01c49-8482-4809-8200-df4e2bb282a8" released by "_delete_snapshot" :: held 3.144s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.733s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0740d583-2ce9-4c2d-bb5e-1f5b16412b58 tempest-GroupsV314Test-696971886 None] Create group from source-group-2af4b1a5-1230-425f-8871-1c09e534dd40 completed successfully. Sep 25 12:42:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Acquiring lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[52828b48-3da8-496a-9a94-2db9b806d5fb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:55 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 Sep 25 12:42:55 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:56 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9" returned: 0 in 0.573s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:56 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9 Sep 25 12:42:56 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:56 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-33cd8bb5-c96e-4130-8631-2380b1fad1a9" returned: 0 in 0.310s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-33cd8bb5-c96e-4130-8631-2380b1fad1a9" released by "delete_volume" :: held 0.962s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Created reservations ['54d54768-2df3-44cc-a928-5d8f95b2156c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:56 devstack cinder-volume[87094]: WARNING cinder.quota [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1451764362 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1451764362, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:42:56 devstack cinder-volume[87094]: WARNING cinder.quota [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1451764362 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1451764362, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Created reservations ['0dbcfe8c-141e-43dd-9d89-914066fc2c1d', '5edf1219-ed6c-4125-b088-2ead39f2ed7e', '5c9bdb60-a577-4e35-8488-8b0d508ab672', '260c8045-51fa-4b13-9ac5-1dbe71f361a6'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:56 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:56 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:56 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8aed1da3-4063-4e48-9b68-4a1ef2bbb1ed tempest-GroupsV314Test-696971886 None] Delete group completed successfully. Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Acquiring lock "cinder-quobyte-921fa5b1-1d61-4229-8a39-d8794d231f4c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-921fa5b1-1d61-4229-8a39-d8794d231f4c" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089aafc-1658-45bc-a9a9-54f9b959a50e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:57 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:57 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:57 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 0.643s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:58 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c Sep 25 12:42:58 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fbbae644-0e19-49ff-b53a-3e28d77addab tempest-GroupSnapshotsV319Test-1196487447 None] Group tempest-GroupSnapshotsV319Test-Group-832412565: creating Sep 25 12:42:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fbbae644-0e19-49ff-b53a-3e28d77addab tempest-GroupSnapshotsV319Test-1196487447 None] Group tempest-GroupSnapshotsV319Test-Group-832412565: created successfully Sep 25 12:42:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fbbae644-0e19-49ff-b53a-3e28d77addab tempest-GroupSnapshotsV319Test-1196487447 None] Create group completed successfully. Sep 25 12:42:58 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-921fa5b1-1d61-4229-8a39-d8794d231f4c" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Lock "cinder-quobyte-921fa5b1-1d61-4229-8a39-d8794d231f4c" released by "delete_volume" :: held 1.279s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Created reservations ['2c48ac62-fb3d-4539-8216-0848d8cc086d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Created reservations ['a50c27ef-a30a-4951-9deb-c14074304e0b', '131a8065-6ec7-4390-acd4-8ffd3dbc055a', 'd7c8c8b2-598e-4f4d-a10d-00ca643fe9d0', '133be7dd-b1e3-45f5-94b9-58eb741bc2a2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:59 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:42:59 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:59 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.509s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:59 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b3a84579-5511-4fdf-a5e1-b784984c31cb tempest-GroupsV314Test-696971886 None] Delete group completed successfully. Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Flow 'volume_create_manager' (9f1a5cb7-909a-4e51-ac6e-67801d9b5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4436f61-9824-49ae-91a0-e9242a0b5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4436f61-9824-49ae-91a0-e9242a0b5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80079984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e279c21-80a5-4923-8ca7-0f48038ec6da,host='devstack@QuobyteHD#QuobyteHD',id=08463d98-6838-40a5-b53f-cfe6ea77ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3cebf5cf8b402798d1bcac1540a5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:00Z,use_quota=True,user_id='cd705105960b462398243d718d13c1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe121730-91b3-4660-ae91-34c5a3a0c6ca),volume_type_id=fe121730-91b3-4660-ae91-34c5a3a0c6ca)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e1ee0-14be-4245-a9cc-97c4a4149027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e1ee0-14be-4245-a9cc-97c4a4149027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4fc0b0-dfb6-4425-b09a-a078d52bf87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4fc0b0-dfb6-4425-b09a-a078d52bf87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08463d98-6838-40a5-b53f-cfe6ea77ea2e', 'volume_name': 'volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad77244-b05a-4079-90c5-8fed5232183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad77244-b05a-4079-90c5-8fed5232183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82c10c0-bae2-4006-aa4e-188e060922fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:00 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Volume 08463d98-6838-40a5-b53f-cfe6ea77ea2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e', 'volume_size': 1} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e279c21-80a5-4923-8ca7-0f48038ec6da,created_at=2026-09-25T10:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80079984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e279c21-80a5-4923-8ca7-0f48038ec6da,host='devstack@QuobyteHD#QuobyteHD',id=08463d98-6838-40a5-b53f-cfe6ea77ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3cebf5cf8b402798d1bcac1540a5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:00Z,use_quota=True,user_id='cd705105960b462398243d718d13c1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe121730-91b3-4660-ae91-34c5a3a0c6ca),volume_type_id=fe121730-91b3-4660-ae91-34c5a3a0c6ca)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Creating volume 08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:00 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:00 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e 1073741824 Sep 25 12:43:00 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:01 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e 1073741824" returned: 0 in 0.546s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:01 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e Sep 25 12:43:01 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:01 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e" returned: 0 in 0.367s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82c10c0-bae2-4006-aa4e-188e060922fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da34c226-249a-41bb-8ccd-a008bac8df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Volume volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e (08463d98-6838-40a5-b53f-cfe6ea77ea2e): created successfully Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da34c226-249a-41bb-8ccd-a008bac8df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Flow 'volume_create_manager' (9f1a5cb7-909a-4e51-ac6e-67801d9b5b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-defbbf1a-42de-40b4-a34d-1f87c176abea tempest-GroupSnapshotsV319Test-1196487447 None] Created volume successfully. Sep 25 12:43:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] GroupSnapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: creating. Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Group snapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: creating. {{(pid=87094) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Creating offline snapshot 77ca881a-3026-4499-8aac-f8be5f232e27 of volume 08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[594f6a90-6d19-4e6b-a799-2a92865862b8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:04 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e Sep 25 12:43:04 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:04 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:04 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 1G Sep 25 12:43:04 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:05 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 1G" returned: 0 in 0.997s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:05 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 Sep 25 12:43:05 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:06 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27" returned: 0 in 0.559s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:06 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:06 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 Sep 25 12:43:06 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:06 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:06 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info Sep 25 12:43:06 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:07 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:07 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:07 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info Sep 25 12:43:07 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:07 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.info" returned: 0 in 0.347s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.516s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-74262f87-b9bb-42bf-8741-f999c38207a5 tempest-GroupSnapshotsV319Test-1196487447 None] group_snapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: created successfully Sep 25 12:43:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] group_snapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: deleting Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] group_snapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: deleting {{(pid=87094) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "cinder-quobyte-77ca881a-3026-4499-8aac-f8be5f232e27" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-77ca881a-3026-4499-8aac-f8be5f232e27" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Deleting offline snapshot 77ca881a-3026-4499-8aac-f8be5f232e27 of volume 08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] snapshot_file for this snap is: volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d21b17f-b57a-4cbb-90a4-358bcf60de43]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Acquiring lock "cinder-f3866318-3493-47d3-8d9e-c0a375ef49a3-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:09 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 Sep 25 12:43:09 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "cinder-f3866318-3493-47d3-8d9e-c0a375ef49a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Acquiring lock "cinder-quobyte-f3866318-3493-47d3-8d9e-c0a375ef49a3" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "cinder-quobyte-f3866318-3493-47d3-8d9e-c0a375ef49a3" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53c56f-b630-45f5-b6ec-a0d226d7e410]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:09 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 Sep 25 12:43:09 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:09 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9c4f6b-da98-4204-8c0a-7992d4f1c1a9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c10e20c6-78a3-4489-b069-d9d5af29ac9a tempest-GroupsV320Test-2010513396 None] Group tempest-GroupsV320Test-Group-711974840: creating Sep 25 12:43:09 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e Sep 25 12:43:09 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c10e20c6-78a3-4489-b069-d9d5af29ac9a tempest-GroupsV320Test-2010513396 None] Group tempest-GroupsV320Test-Group-711974840: created successfully Sep 25 12:43:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c10e20c6-78a3-4489-b069-d9d5af29ac9a tempest-GroupsV320Test-2010513396 None] Create group completed successfully. Sep 25 12:43:10 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3" returned: 0 in 0.555s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:10 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3 Sep 25 12:43:10 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:10 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e" returned: 0 in 0.500s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:10 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3866318-3493-47d3-8d9e-c0a375ef49a3" returned: 0 in 0.307s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:10 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 Sep 25 12:43:10 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "cinder-quobyte-f3866318-3493-47d3-8d9e-c0a375ef49a3" released by "delete_volume" :: held 0.944s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Created reservations ['97f2e9a2-7fd8-41e5-99c0-f5bbfb988511', 'ec40c472-91c0-4aa7-93cc-b07a4627bd5f', '5a2564f5-8b60-456f-b192-6693de8b12a5', 'a4507337-b379-4678-85e6-80c9854d62d9'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:10 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:10 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:10 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27" returned: 0 in 0.515s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:10 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27 Sep 25 12:43:10 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:10 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Deleted volume successfully. Sep 25 12:43:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d3d2b861-73a8-4af3-93d7-e4ff65e39bfe tempest-AttachVolumeShelveTestJSON-1204317678 None] Lock "cinder-f3866318-3493-47d3-8d9e-c0a375ef49a3-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:11 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e.77ca881a-3026-4499-8aac-f8be5f232e27" returned: 0 in 0.379s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-77ca881a-3026-4499-8aac-f8be5f232e27" released by "_delete_snapshot" :: held 2.158s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" released by "delete_snapshot" :: held 2.190s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:11 devstack cinder-volume[87094]: WARNING cinder.quota [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-982999816 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-982999816, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:43:11 devstack cinder-volume[87094]: WARNING cinder.quota [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-982999816 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-982999816, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] Created reservations ['dda528da-813c-42b2-8eb3-08bff06c274f', '30320fa1-4b3c-4d94-8204-657e0dfc322b', '98303ff3-8364-4789-85c1-95853b68ec16', 'e6ae02da-e0e4-436b-8afc-f046a5d6e76e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e93ba7fb-a5c4-4d97-829d-220714d527a0 tempest-GroupSnapshotsV319Test-1196487447 None] group_snapshot dc195e6b-cc9c-4485-b22b-a6fbccd3d308: deleted successfully Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Created reservations ['0b2c6b59-0331-4bf2-a435-444ceca59607'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:11 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:11 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" acquired by "delete_volume" :: waited 0.068s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03c1e9-9c61-453b-9f7f-5a72952bbde4]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:12 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.357s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3078c050-b77b-4cfc-b4a7-d1a1242c3d9a tempest-GroupsV320Test-2010513396 None] Delete group completed successfully. Sep 25 12:43:12 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e Sep 25 12:43:12 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:12 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e" returned: 0 in 0.482s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:12 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e Sep 25 12:43:12 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:12 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-08463d98-6838-40a5-b53f-cfe6ea77ea2e" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "cinder-quobyte-08463d98-6838-40a5-b53f-cfe6ea77ea2e" released by "delete_volume" :: held 0.956s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Created reservations ['a0e6a2c8-300d-4e7b-862c-42a2133bcd30'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:13 devstack cinder-volume[87094]: WARNING cinder.quota [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-982999816 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-982999816, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Created reservations ['0720e656-60ec-42e5-a779-f3decfe29856', 'de2c49b6-5d23-45fa-a842-fa8d75673dc6', 'e365988c-44b8-40a5-95fa-bcca2076456d', '9883b3f4-204a-4ea0-bac9-b01601f7fe8c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:13 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:13 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:13 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.543s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:13 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-92121354-bb06-4a6f-9aeb-6bf2f175d204 tempest-GroupSnapshotsV319Test-1196487447 None] Delete group completed successfully. Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (9fcdbe83-98aa-47aa-b910-8b99b95bad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d627886-d244-48e2-a250-cdefb86a7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d627886-d244-48e2-a250-cdefb86a7928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1231735099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c10165-39a2-4d60-8e4a-788c5610c075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:18Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683bb765-042d-49ed-a583-499b43a479cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683bb765-042d-49ed-a583-499b43a479cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba89e88e-c4b1-41ac-9ac1-3216797d947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba89e88e-c4b1-41ac-9ac1-3216797d947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c10165-39a2-4d60-8e4a-788c5610c075', 'volume_name': 'volume-60c10165-39a2-4d60-8e4a-788c5610c075', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0040cd78-912e-44cc-b836-cac54419a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0040cd78-912e-44cc-b836-cac54419a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662e825e-6aec-4f2b-a225-1af3f4e1187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Volume 60c10165-39a2-4d60-8e4a-788c5610c075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c10165-39a2-4d60-8e4a-788c5610c075', 'volume_size': 1} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1231735099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c10165-39a2-4d60-8e4a-788c5610c075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:18Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Creating volume 60c10165-39a2-4d60-8e4a-788c5610c075 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:18 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:18 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 1073741824 Sep 25 12:43:18 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:19 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 1073741824" returned: 0 in 0.842s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:19 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 Sep 25 12:43:19 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:19 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075" returned: 0 in 0.461s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662e825e-6aec-4f2b-a225-1af3f4e1187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c10165-39a2-4d60-8e4a-788c5610c075', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b5d39-577a-4e96-ac39-9a1d288028b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Volume volume-60c10165-39a2-4d60-8e4a-788c5610c075 (60c10165-39a2-4d60-8e4a-788c5610c075): created successfully Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b5d39-577a-4e96-ac39-9a1d288028b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (9fcdbe83-98aa-47aa-b910-8b99b95bad99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ff296dd4-be1f-483a-bd53-24c3bcf9f601 tempest-AttachVolumeTestJSON-1139178665 None] Created volume successfully. Sep 25 12:43:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-01b29262-c3bd-47f0-a702-746d27c3ae5c req-ec1fcb97-9123-4cbc-88fb-f895923f7135 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-01b29262-c3bd-47f0-a702-746d27c3ae5c req-ec1fcb97-9123-4cbc-88fb-f895923f7135 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-01b29262-c3bd-47f0-a702-746d27c3ae5c req-ec1fcb97-9123-4cbc-88fb-f895923f7135 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-01b29262-c3bd-47f0-a702-746d27c3ae5c req-ec1fcb97-9123-4cbc-88fb-f895923f7135 tempest-AttachVolumeTestJSON-1139178665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-60c10165-39a2-4d60-8e4a-788c5610c075', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a2749b1-7053-481c-892f-6f571ee772ad', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:43:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-01b29262-c3bd-47f0-a702-746d27c3ae5c req-ec1fcb97-9123-4cbc-88fb-f895923f7135 tempest-AttachVolumeTestJSON-1139178665 None] attachment_update completed successfully. Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (34ee9415-05d6-4870-89da-6a461dd2e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8220e32-4604-4d41-b127-2eb0d3b3723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8220e32-4604-4d41-b127-2eb0d3b3723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389840884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f908468-e761-4e37-90f5-8e1eb15d6fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:25Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f317c5-f3c7-4285-af7c-add13052ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f317c5-f3c7-4285-af7c-add13052ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246f3a7-d9b2-4cdd-8d66-67d557dbc96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246f3a7-d9b2-4cdd-8d66-67d557dbc96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f908468-e761-4e37-90f5-8e1eb15d6fda', 'volume_name': 'volume-0f908468-e761-4e37-90f5-8e1eb15d6fda', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4cea82-5323-4ea9-9d4b-f0853413d0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4cea82-5323-4ea9-9d4b-f0853413d0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b946537-5581-4356-9d88-e567e1dbe7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:24 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Volume 0f908468-e761-4e37-90f5-8e1eb15d6fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f908468-e761-4e37-90f5-8e1eb15d6fda', 'volume_size': 1} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389840884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f908468-e761-4e37-90f5-8e1eb15d6fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37427eca1648443e82bcfd2273ed2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:25Z,use_quota=True,user_id='ae2fe6a085c14d55bb75d0d2685539ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Creating volume 0f908468-e761-4e37-90f5-8e1eb15d6fda {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:24 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:24 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda 1073741824 Sep 25 12:43:24 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Flow 'volume_create_manager' (af8cbc5e-4c2f-4aea-af73-861dba47e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a0f8b7-5869-497d-9f3f-9f1d22919149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a0f8b7-5869-497d-9f3f-9f1d22919149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-383558491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40594233-f364-47f7-8c8f-88f2d25c9851,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c2a21c7c57b45a09d478e3196e85ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:25Z,use_quota=True,user_id='c6ffe1005fd6442e8b59983615933c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf28a21-1323-493b-ac82-908019bf62d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf28a21-1323-493b-ac82-908019bf62d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec114e7-f4ea-4967-a887-f2abdc6bf876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec114e7-f4ea-4967-a887-f2abdc6bf876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40594233-f364-47f7-8c8f-88f2d25c9851', 'volume_name': 'volume-40594233-f364-47f7-8c8f-88f2d25c9851', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3f6251-3446-4643-9dd7-7e5c61d4b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3f6251-3446-4643-9dd7-7e5c61d4b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc70361a-af0f-4753-bfb1-134f81c13b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:25 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Volume 40594233-f364-47f7-8c8f-88f2d25c9851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40594233-f364-47f7-8c8f-88f2d25c9851', 'volume_size': 1} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:25 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda 1073741824" returned: 0 in 0.739s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:25 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda Sep 25 12:43:25 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:26 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda" returned: 0 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-383558491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40594233-f364-47f7-8c8f-88f2d25c9851,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c2a21c7c57b45a09d478e3196e85ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:25Z,use_quota=True,user_id='c6ffe1005fd6442e8b59983615933c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Creating volume 40594233-f364-47f7-8c8f-88f2d25c9851 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:26 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b946537-5581-4356-9d88-e567e1dbe7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f908468-e761-4e37-90f5-8e1eb15d6fda', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbc8adc-26b5-4d7e-9aa7-45131451f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:26 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 1073741824 Sep 25 12:43:26 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Volume volume-0f908468-e761-4e37-90f5-8e1eb15d6fda (0f908468-e761-4e37-90f5-8e1eb15d6fda): created successfully Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbc8adc-26b5-4d7e-9aa7-45131451f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Flow 'volume_create_manager' (34ee9415-05d6-4870-89da-6a461dd2e873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b33c8ddb-476e-4715-9c98-ec9e4475c8d3 tempest-AttachVolumeTestJSON-1139178665 None] Created volume successfully. Sep 25 12:43:26 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 1073741824" returned: 0 in 0.679s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:26 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 Sep 25 12:43:26 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:27 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851" returned: 0 in 0.421s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc70361a-af0f-4753-bfb1-134f81c13b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40594233-f364-47f7-8c8f-88f2d25c9851', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9876177e-b30b-49ed-aff3-2d9f705d11ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:27 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Volume volume-40594233-f364-47f7-8c8f-88f2d25c9851 (40594233-f364-47f7-8c8f-88f2d25c9851): created successfully Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9876177e-b30b-49ed-aff3-2d9f705d11ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Flow 'volume_create_manager' (af8cbc5e-4c2f-4aea-af73-861dba47e729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:27 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-698688ab-fc46-4420-81e5-ab5e5440a1e1 req-fdcd0ac8-a2c6-423c-8987-f0215064a128 tempest-VolumesGetTestJSON-2019492249 None] Created volume successfully. Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Acquiring lock "cinder-40594233-f364-47f7-8c8f-88f2d25c9851-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "cinder-40594233-f364-47f7-8c8f-88f2d25c9851-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-19d52d28-a821-4f54-9d32-cc5962922a5b req-480cc50d-728f-416e-a5d4-d0fd99c3dccc tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-19d52d28-a821-4f54-9d32-cc5962922a5b req-480cc50d-728f-416e-a5d4-d0fd99c3dccc tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-19d52d28-a821-4f54-9d32-cc5962922a5b req-480cc50d-728f-416e-a5d4-d0fd99c3dccc tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Acquiring lock "cinder-quobyte-40594233-f364-47f7-8c8f-88f2d25c9851" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "cinder-quobyte-40594233-f364-47f7-8c8f-88f2d25c9851" acquired by "delete_volume" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c612f11-2e64-4ac2-b173-9af08a8a42b5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-19d52d28-a821-4f54-9d32-cc5962922a5b req-480cc50d-728f-416e-a5d4-d0fd99c3dccc tempest-AttachVolumeTestJSON-1139178665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-0f908468-e761-4e37-90f5-8e1eb15d6fda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e57e37ee-8359-406b-96b8-66afd2233b4a', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:43:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-19d52d28-a821-4f54-9d32-cc5962922a5b req-480cc50d-728f-416e-a5d4-d0fd99c3dccc tempest-AttachVolumeTestJSON-1139178665 None] attachment_update completed successfully. Sep 25 12:43:28 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 Sep 25 12:43:28 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:29 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851" returned: 0 in 0.593s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:29 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851 Sep 25 12:43:29 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:29 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-40594233-f364-47f7-8c8f-88f2d25c9851" returned: 0 in 0.535s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "cinder-quobyte-40594233-f364-47f7-8c8f-88f2d25c9851" released by "delete_volume" :: held 1.215s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG cinder.quota [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Created reservations ['1aec6f6c-1dad-4a23-a117-0f43de5539e5', '3cb194e5-e4ba-49cb-b909-a69617037485', '9aa527d7-d999-4567-b1dc-7eacfb00e74f', '44b9dcc2-6164-4296-8d66-94fb309b5056'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:29 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:29 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:30 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.358s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:30 devstack cinder-volume[87094]: DEBUG cinder.manager [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Deleted volume successfully. Sep 25 12:43:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-82498f92-83b3-4ae4-b682-e46f630ebec7 req-d74a61cf-bf29-4035-90e2-f543d5011050 tempest-VolumesGetTestJSON-2019492249 None] Lock "cinder-40594233-f364-47f7-8c8f-88f2d25c9851-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-957562e3-b723-4fb3-829c-a90033a48eeb req-8d01294c-5a11-456f-b200-0059fe996bc4 tempest-AttachVolumeTestJSON-1139178665 None] Terminate volume connection completed successfully. Sep 25 12:43:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-957562e3-b723-4fb3-829c-a90033a48eeb req-8d01294c-5a11-456f-b200-0059fe996bc4 tempest-AttachVolumeTestJSON-1139178665 None] Deleting attachment 0a2749b1-7053-481c-892f-6f571ee772ad. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:43:33 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-7e3b1ac8-d5dd-43b0-8d6d-8f5be4d06b4f req-7e2e413d-61bc-4e8e-bc77-b7e060a85724 tempest-AttachVolumeTestJSON-1139178665 None] Terminate volume connection completed successfully. Sep 25 12:43:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-7e3b1ac8-d5dd-43b0-8d6d-8f5be4d06b4f req-7e2e413d-61bc-4e8e-bc77-b7e060a85724 tempest-AttachVolumeTestJSON-1139178665 None] Deleting attachment e57e37ee-8359-406b-96b8-66afd2233b4a. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Flow 'volume_create_manager' (8f8d8e94-a472-43d3-8b02-398e17296fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe9086-804e-4b40-bfa1-d7c75988ad61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe9086-804e-4b40-bfa1-d7c75988ad61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-451805887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61799b51-2027-450b-bc39-9112415067fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07d8c5e684281be17a8f4b739f025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:38Z,use_quota=True,user_id='9e7d65e45bde4c87bceed7433cc7f6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c6c13-2de8-4890-8da9-a8e26158c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c6c13-2de8-4890-8da9-a8e26158c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e39247-cb11-4841-bad2-74aea8f78b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e39247-cb11-4841-bad2-74aea8f78b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61799b51-2027-450b-bc39-9112415067fb', 'volume_name': 'volume-61799b51-2027-450b-bc39-9112415067fb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f30306-e28d-464d-978a-8cc19cd33750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f30306-e28d-464d-978a-8cc19cd33750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294bcede-1463-4218-8594-e472f0700e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:38 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Volume 61799b51-2027-450b-bc39-9112415067fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61799b51-2027-450b-bc39-9112415067fb', 'volume_size': 1} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-451805887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61799b51-2027-450b-bc39-9112415067fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc07d8c5e684281be17a8f4b739f025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:38Z,use_quota=True,user_id='9e7d65e45bde4c87bceed7433cc7f6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Creating volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:38 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:38 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb 1073741824 Sep 25 12:43:38 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:39 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb 1073741824" returned: 0 in 0.758s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:39 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb Sep 25 12:43:39 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:39 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb" returned: 0 in 0.301s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294bcede-1463-4218-8594-e472f0700e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61799b51-2027-450b-bc39-9112415067fb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d560e0b-d766-43f0-9a9a-682d58158f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Volume volume-61799b51-2027-450b-bc39-9112415067fb (61799b51-2027-450b-bc39-9112415067fb): created successfully Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d560e0b-d766-43f0-9a9a-682d58158f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Flow 'volume_create_manager' (8f8d8e94-a472-43d3-8b02-398e17296fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-33664491-bca5-469b-8fe0-2e49bcf0f7d5 tempest-SnapshotsActionsTest-1882658921 None] Created volume successfully. Sep 25 12:43:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-554b8218-3582-4743-8d59-649820b4d1a5 tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-1549759236: creating Sep 25 12:43:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-554b8218-3582-4743-8d59-649820b4d1a5 tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-1549759236: created successfully Sep 25 12:43:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-554b8218-3582-4743-8d59-649820b4d1a5 tempest-GroupSnapshotsTest-52754260 None] Create group completed successfully. Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Creating offline snapshot 2f115daf-a34e-4379-a6e1-e48459a51018 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8263a3-3438-427f-afea-c587404f564e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:40 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb Sep 25 12:43:40 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-0f908468-e761-4e37-90f5-8e1eb15d6fda-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-0f908468-e761-4e37-90f5-8e1eb15d6fda-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-quobyte-0f908468-e761-4e37-90f5-8e1eb15d6fda" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-0f908468-e761-4e37-90f5-8e1eb15d6fda" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dcb961-13d6-44e7-990c-9bb0ba3d3a8e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:41 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb" returned: 0 in 0.452s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:41 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 1G Sep 25 12:43:41 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:41 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda Sep 25 12:43:41 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:41 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda" returned: 0 in 0.505s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:41 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda Sep 25 12:43:41 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:41 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 1G" returned: 0 in 0.606s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:41 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:43:41 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:41 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0f908468-e761-4e37-90f5-8e1eb15d6fda" returned: 0 in 0.339s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-0f908468-e761-4e37-90f5-8e1eb15d6fda" released by "delete_volume" :: held 0.916s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Created reservations ['d804a7f6-ad30-4b46-b894-5002107c91e8', '2163884a-d59f-428f-b5e2-44ffbf734916', '890e135e-abcf-4da9-9f30-8df00431540a', '1bdacd12-a8f9-4d4f-863f-608ababbd10e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:42 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.488s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:42 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 is being set with open permissions: ugo+rw Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:42 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:42 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:42 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:43:42 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (5ee10176-87ae-4764-a802-3e1c507777f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76da75-45ef-42a6-9658-bd8a25c97c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76da75-45ef-42a6-9658-bd8a25c97c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-972524219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f3e4da1-94c6-4d5b-b230-b49dc55a8067,host='devstack@QuobyteHD#QuobyteHD',id=c8abe2a7-06c9-4856-978f-769742681fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:42Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(927f55c4-091e-4008-aca6-006f2958400a),volume_type_id=927f55c4-091e-4008-aca6-006f2958400a)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:42 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6510a7e0-33f1-4e4c-ad69-d7d1677e9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6510a7e0-33f1-4e4c-ad69-d7d1677e9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895a4a8-0882-47d7-aac0-d324bcde20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895a4a8-0882-47d7-aac0-d324bcde20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8abe2a7-06c9-4856-978f-769742681fda', 'volume_name': 'volume-c8abe2a7-06c9-4856-978f-769742681fda', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35cb35-5142-4c1c-95bb-7b6361f67243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f35cb35-5142-4c1c-95bb-7b6361f67243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743022f8-6626-48e7-8976-d1868a22a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Volume c8abe2a7-06c9-4856-978f-769742681fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8abe2a7-06c9-4856-978f-769742681fda', 'volume_size': 1} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-60c10165-39a2-4d60-8e4a-788c5610c075-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Deleted volume successfully. Sep 25 12:43:42 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.496s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-60c10165-39a2-4d60-8e4a-788c5610c075-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9d9a9e1d-dc9d-4998-b945-b53d186e1636 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-0f908468-e761-4e37-90f5-8e1eb15d6fda-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:42 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info Sep 25 12:43:42 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-quobyte-60c10165-39a2-4d60-8e4a-788c5610c075" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-60c10165-39a2-4d60-8e4a-788c5610c075" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa52e4-9245-4219-a816-08f74476359b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:43 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 Sep 25 12:43:43 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:43 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info" returned: 0 in 0.308s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:43 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info is being set with open permissions: ugo+rw Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:43 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info Sep 25 12:43:43 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:43 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075" returned: 0 in 0.431s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:43 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075 Sep 25 12:43:43 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:43 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.info" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f3e4da1-94c6-4d5b-b230-b49dc55a8067,created_at=2026-09-25T10:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-972524219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f3e4da1-94c6-4d5b-b230-b49dc55a8067,host='devstack@QuobyteHD#QuobyteHD',id=c8abe2a7-06c9-4856-978f-769742681fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:42Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(927f55c4-091e-4008-aca6-006f2958400a),volume_type_id=927f55c4-091e-4008-aca6-006f2958400a)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Creating volume c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:43 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=85,cinder:SELECT=100,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:43:43 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda 1073741824 Sep 25 12:43:43 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-99a7c2b3-0e09-410d-99bf-0f7f43d78e2b tempest-SnapshotsActionsTest-1882658921 None] Create snapshot completed successfully Sep 25 12:43:43 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-60c10165-39a2-4d60-8e4a-788c5610c075" returned: 0 in 0.295s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-60c10165-39a2-4d60-8e4a-788c5610c075" released by "delete_volume" :: held 0.781s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Created reservations ['49de6496-d62a-42f3-b53c-1a94ead6329b', '4b0aae71-e5e9-47ce-8a86-a88510693f77', 'b5cd2aee-5d08-4429-b523-2e9d32846f9d', 'be1bad8d-cbf8-4c4c-97e2-d71c087b3461'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:43 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:43 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-8c0bca16-7d64-409f-846e-7814bf5a405a-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:44 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda 1073741824" returned: 0 in 0.772s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-8c0bca16-7d64-409f-846e-7814bf5a405a-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "cinder-quobyte-8c0bca16-7d64-409f-846e-7814bf5a405a" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:44 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:43:44 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-8c0bca16-7d64-409f-846e-7814bf5a405a" acquired by "delete_volume" :: waited 0.054s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30a437-a185-4929-852e-f9aee0738507]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:44 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.597s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Deleted volume successfully. Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d912e572-7278-4d5b-84c1-a5f5dc007965 tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-60c10165-39a2-4d60-8e4a-788c5610c075-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:44 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a Sep 25 12:43:44 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:44 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.521s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743022f8-6626-48e7-8976-d1868a22a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8abe2a7-06c9-4856-978f-769742681fda', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db105617-601c-4e6a-95c8-24af27faad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Volume volume-c8abe2a7-06c9-4856-978f-769742681fda (c8abe2a7-06c9-4856-978f-769742681fda): created successfully Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db105617-601c-4e6a-95c8-24af27faad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (5ee10176-87ae-4764-a802-3e1c507777f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72b75d02-feb5-498c-a6fe-0402a0bba307 tempest-GroupSnapshotsTest-52754260 None] Created volume successfully. Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Creating offline snapshot 9c671d74-222e-4edb-8d25-e596374febb8 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa34e16-a11f-4c46-997b-038a1b29abd1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a" returned: 0 in 0.710s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a Sep 25 12:43:45 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:43:45 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8c0bca16-7d64-409f-846e-7814bf5a405a" returned: 0 in 0.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-quobyte-8c0bca16-7d64-409f-846e-7814bf5a405a" released by "delete_volume" :: held 1.126s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Created reservations ['d9c137d2-4499-4d8b-a6d7-4c395c0ec800', '94e3a53d-d003-4ff7-b574-6bc7423938ff', 'b38ac539-cc2c-4606-8dd3-e9cba41ee515', '71cfe502-d679-44aa-9e58-41e003c31ae0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.642s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:45 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 1G Sep 25 12:43:45 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:46 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.381s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:46 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Deleted volume successfully. Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-34863a94-a9c8-4e36-82bb-0bc2d55400fc tempest-AttachVolumeTestJSON-1139178665 None] Lock "cinder-8c0bca16-7d64-409f-846e-7814bf5a405a-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:46 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 1G" returned: 0 in 0.727s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:46 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 Sep 25 12:43:46 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:46 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] GroupSnapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: creating. Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Group snapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: creating. {{(pid=87094) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:46 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8" returned: 0 in 0.437s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:46 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 is being set with open permissions: ugo+rw Sep 25 12:43:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:46 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 Sep 25 12:43:46 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:47 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:43:47 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:47 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.736s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Creating offline snapshot 2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 of volume c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f7d7a259-6ec8-46db-a4ec-3c3888c4e1ab tempest-SnapshotsActionsTest-1882658921 None] Create snapshot completed successfully Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73a079f-f223-4e1f-bc8a-5d33a117589d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:47 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.328s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:43:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:43:47 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:43:47 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:48 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.572s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:48 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 1G Sep 25 12:43:48 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-9c671d74-222e-4edb-8d25-e596374febb8-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-9c671d74-222e-4edb-8d25-e596374febb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-9c671d74-222e-4edb-8d25-e596374febb8" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-9c671d74-222e-4edb-8d25-e596374febb8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Deleting offline snapshot 9c671d74-222e-4edb-8d25-e596374febb8 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] snapshot_file for this snap is: volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6bc78-83ca-4437-9f0d-d92adc2eac32]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:48 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 1G" returned: 0 in 0.742s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8abe2a7-06c9-4856-978f-769742681fda -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:48 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8abe2a7-06c9-4856-978f-769742681fda -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:43:48 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:48 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 Sep 25 12:43:48 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8abe2a7-06c9-4856-978f-769742681fda -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.484s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8" returned: 0 in 0.638s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:49 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:43:49 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3981bd-4b57-4538-ab77-8d464e331c74]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:43:49 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.362s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info Sep 25 12:43:49 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.593s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 Sep 25 12:43:49 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:50 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info" returned: 0 in 0.428s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:50 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:50 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info Sep 25 12:43:50 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:50 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.info" returned: 0 in 0.377s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:50 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8" returned: 0 in 0.768s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1e843b01-40fe-445d-adc9-2888410ef519 tempest-GroupSnapshotsTest-52754260 None] group_snapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: created successfully Sep 25 12:43:50 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8 Sep 25 12:43:50 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:51 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9c671d74-222e-4edb-8d25-e596374febb8" returned: 0 in 0.374s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-9c671d74-222e-4edb-8d25-e596374febb8" released by "_delete_snapshot" :: held 2.530s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_snapshot" :: held 2.571s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Created reservations ['883406cc-fdd2-4a29-a5dc-96e126741571', 'ec70315e-2acb-453d-8405-40a7e411cab1', '61e732c5-ea90-48db-b2b7-4921d6d58676', '00e75fe9-547d-4f09-b288-33194086caf3'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Delete snapshot completed successfully. Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ad059ce-699f-449e-a7e2-02ad89a18032 tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-9c671d74-222e-4edb-8d25-e596374febb8-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67-3311011f-f50e-426b-8b6b-f0f4b830730b" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67-3311011f-f50e-426b-8b6b-f0f4b830730b" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Creating volume 3311011f-f50e-426b-8b6b-f0f4b830730b from snapshot 2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] snapshot: 2f58fe2a-fb51-49a0-b47a-1fc1fc978e67, volume: 3311011f-f50e-426b-8b6b-f0f4b830730b, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04343a-70fd-498c-8ae3-1b8c7e6fa14f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:43:52 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:52 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8abe2a7-06c9-4856-978f-769742681fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b8e4e-b808-4a5d-b264-915d9a6ac29a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:53 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:43:53 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:53 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.649s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:43:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:43:53 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:43:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:53 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b Sep 25 12:43:53 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:02 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=28,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:44:02 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=131,cinder:SELECT=113,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:44:02 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b" returned: 0 in 9.296s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:02 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:44:02 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Converted 1024.00 MB image at 110.14 MB/s Sep 25 12:44:02 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:02 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b Sep 25 12:44:02 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:03 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b" returned: 0 in 0.278s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" released by "_copy_volume_from_snapshot" :: held 11.104s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67-3311011f-f50e-426b-8b6b-f0f4b830730b" released by "_create_volume_from_snapshot" :: held 11.239s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.277s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.529s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Creating offline snapshot 9fc3d950-c1a8-451b-9b72-783ed6f3d889 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f10d0-fa77-4b09-9dc8-9ff0e055d780]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-510ca9f4-84ba-40cd-a066-9762bd5300e4 tempest-GroupSnapshotsTest-52754260 None] Create group from source-snapshot-ee75f4e8-cd20-4505-8f1c-df544ce01301 completed successfully. Sep 25 12:44:03 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:03 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:03 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.544s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:03 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 1G Sep 25 12:44:03 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:04 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 1G" returned: 0 in 0.685s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:04 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 Sep 25 12:44:04 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0949da-498d-4a06-860c-48a780b56f24]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:04 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b Sep 25 12:44:04 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:04 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:04 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 is being set with open permissions: ugo+rw Sep 25 12:44:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:05 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 Sep 25 12:44:05 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:05 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:05 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b" returned: 0 in 0.832s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:05 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b Sep 25 12:44:05 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-77f30be8-a39b-41b8-8e2b-733514c0f888 tempest-SnapshotsActionsTest-1882658921 None] Create snapshot completed successfully Sep 25 12:44:05 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3311011f-f50e-426b-8b6b-f0f4b830730b" returned: 0 in 0.467s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-3311011f-f50e-426b-8b6b-f0f4b830730b" released by "delete_volume" :: held 1.390s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-9fc3d950-c1a8-451b-9b72-783ed6f3d889-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-9fc3d950-c1a8-451b-9b72-783ed6f3d889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-9fc3d950-c1a8-451b-9b72-783ed6f3d889" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-9fc3d950-c1a8-451b-9b72-783ed6f3d889" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Deleting offline snapshot 9fc3d950-c1a8-451b-9b72-783ed6f3d889 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] snapshot_file for this snap is: volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Created reservations ['b60fa160-6cff-43d1-b85f-7fe0ce1eef23'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed24a8-68d9-4f59-b1b0-1da36208bf91]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:06 devstack cinder-volume[87094]: WARNING cinder.quota [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-992884378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-992884378, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:06 devstack cinder-volume[87094]: WARNING cinder.quota [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-992884378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-992884378, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Created reservations ['8a595292-c159-477a-982e-866ed927b3f2', 'ba80df84-7c9a-4d00-a902-1b615fd753fe', '7f89ae7f-8d2b-4199-a065-df2c74bc2578', 'fc121dd4-2c01-4981-98f1-bcc4c44e2115'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:06 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 Sep 25 12:44:06 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:06 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:06 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:06 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.365s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:06 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f33f5268-fe10-43ea-9450-beac809a4557 tempest-GroupSnapshotsTest-52754260 None] Delete group completed successfully. Sep 25 12:44:06 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889" returned: 0 in 0.647s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[608556a0-48bf-4615-92f2-447f8e57ebb0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:07 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:07 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] group_snapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: deleting Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] group_snapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: deleting {{(pid=87094) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Deleting offline snapshot 2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 of volume c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:07 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] snapshot_file for this snap is: volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.677s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f7b7f6-3747-445f-9b7e-619b219f0688]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:07 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 Sep 25 12:44:07 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:07 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:44:07 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:08 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.647s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8abe2a7-06c9-4856-978f-769742681fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:08 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889" returned: 0 in 0.709s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3146b2-7399-463a-896a-7f8e0eb12475]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:08 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889 Sep 25 12:44:08 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:08 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:44:08 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:08 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.9fc3d950-c1a8-451b-9b72-783ed6f3d889" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-9fc3d950-c1a8-451b-9b72-783ed6f3d889" released by "_delete_snapshot" :: held 2.592s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_snapshot" :: held 2.648s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Created reservations ['66fa7c24-524f-4795-b53f-bc331a791dbb', 'c24edbd6-d7ed-4372-9b17-3e30a4f4e72c', '3cac563f-61df-44f1-8c44-3f9c4e4d006b', '0c1ebaf3-3f19-464d-89bb-e4f85ff4bbcb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Delete snapshot completed successfully. Sep 25 12:44:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9a174d24-8312-4824-b82c-02dc6ad178fe tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-9fc3d950-c1a8-451b-9b72-783ed6f3d889-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:09 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.857s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:09 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:44:09 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:09 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.566s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:09 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67 Sep 25 12:44:09 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Creating offline snapshot 264c6543-c37e-4431-9c1c-5f5a747d2d16 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e26850-0b81-4176-9965-85ddbe9fcd56]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:10 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda.2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-2f58fe2a-fb51-49a0-b47a-1fc1fc978e67" released by "_delete_snapshot" :: held 2.780s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" released by "delete_snapshot" :: held 2.831s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:10 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:10 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:10 devstack cinder-volume[87094]: WARNING cinder.quota [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-992884378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-992884378, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] Created reservations ['a87c2307-b2b8-4ba3-bfca-44fb3f2395bd', 'd7682da2-3493-437c-9a6b-84a00630c1fb', 'a4361d9a-acc6-4546-8b29-f4e476449ab6', '5270d6ca-ae9d-4003-8fcc-09a99e6163dc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8768cfef-1daf-41cf-8974-093e184a7d14 tempest-GroupSnapshotsTest-52754260 None] group_snapshot ee75f4e8-cd20-4505-8f1c-df544ce01301: deleted successfully Sep 25 12:44:10 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.675s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:10 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 1G Sep 25 12:44:10 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:11 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 1G" returned: 0 in 0.739s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf21c5c5-f240-4907-89b7-e66f5c704957]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:11 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 Sep 25 12:44:11 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:11 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:44:11 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:12 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16" returned: 0 in 0.564s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 is being set with open permissions: ugo+rw Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:12 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 Sep 25 12:44:12 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:12 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.593s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:12 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda Sep 25 12:44:12 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:12 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16" returned: 0 in 0.410s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c8abe2a7-06c9-4856-978f-769742681fda" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-c8abe2a7-06c9-4856-978f-769742681fda" released by "delete_volume" :: held 1.176s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3798531b-48dc-41b3-809f-70b712441e0c tempest-SnapshotsActionsTest-1882658921 None] Create snapshot completed successfully Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Created reservations ['a4b10813-847d-4a2d-a230-9723d6515a7d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:12 devstack cinder-volume[87094]: WARNING cinder.db.api [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-992884378'] Sep 25 12:44:12 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Created reservations ['48ff163b-ffd7-4f48-a0ba-01e5a2694dac', '47d0a8f1-5052-449b-a6ba-2f635db6e656', '4fd4669e-5093-4a62-a0f0-d70b071ebd84', '4655a316-fc83-4d8f-a844-7936d2b8e8eb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:13 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:13 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6c6fb33f-23e9-4540-9054-8a212021e172 tempest-GroupsTest-1243025194 None] Group tempest-Group1-1833829515: creating Sep 25 12:44:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6c6fb33f-23e9-4540-9054-8a212021e172 tempest-GroupsTest-1243025194 None] Group tempest-Group1-1833829515: created successfully Sep 25 12:44:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6c6fb33f-23e9-4540-9054-8a212021e172 tempest-GroupsTest-1243025194 None] Create group completed successfully. Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-264c6543-c37e-4431-9c1c-5f5a747d2d16-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:13 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-264c6543-c37e-4431-9c1c-5f5a747d2d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.465s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0726a8dc-dcfd-4746-bb8e-3386cf619f4f tempest-GroupSnapshotsTest-52754260 None] Delete group completed successfully. Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-264c6543-c37e-4431-9c1c-5f5a747d2d16" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-264c6543-c37e-4431-9c1c-5f5a747d2d16" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Deleting offline snapshot 264c6543-c37e-4431-9c1c-5f5a747d2d16 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] snapshot_file for this snap is: volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e6f6e0-dfe7-46f7-a16c-e56c3bbbbda3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:13 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 Sep 25 12:44:13 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:14 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16" returned: 0 in 0.527s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d50b5-9bba-432c-9836-7589cae77042]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:14 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:14 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:14 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.619s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:14 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 Sep 25 12:44:14 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8d786843-3fe4-4117-ac9c-b8160b1af75f tempest-GroupsTest-1243025194 None] Group tempest-Group2-1128921326: creating Sep 25 12:44:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8d786843-3fe4-4117-ac9c-b8160b1af75f tempest-GroupsTest-1243025194 None] Group tempest-Group2-1128921326: created successfully Sep 25 12:44:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f27fbc50-55b0-4702-b50e-464fa7d568ed tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-971329482: creating Sep 25 12:44:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8d786843-3fe4-4117-ac9c-b8160b1af75f tempest-GroupsTest-1243025194 None] Create group completed successfully. Sep 25 12:44:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f27fbc50-55b0-4702-b50e-464fa7d568ed tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-971329482: created successfully Sep 25 12:44:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f27fbc50-55b0-4702-b50e-464fa7d568ed tempest-GroupSnapshotsTest-52754260 None] Create group completed successfully. Sep 25 12:44:15 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16" returned: 0 in 0.574s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:15 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16 Sep 25 12:44:15 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:15 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.264c6543-c37e-4431-9c1c-5f5a747d2d16" returned: 0 in 0.417s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-264c6543-c37e-4431-9c1c-5f5a747d2d16" released by "_delete_snapshot" :: held 2.326s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_snapshot" :: held 2.360s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:15 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Created reservations ['4e4957cb-8e2f-4cc6-bf9f-e1e0ccc97ffb', '93eaa6dc-55eb-4353-90ab-a7170b51257d', '67c96046-16b2-437a-8a24-7270901c4af0', 'c12d8917-24e5-4587-9dad-e4c5a29f7ef4'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Delete snapshot completed successfully. Sep 25 12:44:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ec15cdfd-0064-4091-936f-e96ac170d54e tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-264c6543-c37e-4431-9c1c-5f5a747d2d16-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (3c22ab2e-7da5-4a66-8406-e4726c9e5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8644ca10-e55c-4416-899a-751d738a083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8644ca10-e55c-4416-899a-751d738a083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467204339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a92540-2f24-40ba-88b7-dcca94d52203,host='devstack@QuobyteHD#QuobyteHD',id=3df107c2-bc1c-4604-b35a-0b27132c7e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:17Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(157b5783-ec63-49be-9519-98f20ed20b19),volume_type_id=157b5783-ec63-49be-9519-98f20ed20b19)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36d2c0f-6760-40cc-a15e-8bf577d8d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36d2c0f-6760-40cc-a15e-8bf577d8d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a43683-5bf3-426d-aaaa-6b3034c448d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a43683-5bf3-426d-aaaa-6b3034c448d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df107c2-bc1c-4604-b35a-0b27132c7e87', 'volume_name': 'volume-3df107c2-bc1c-4604-b35a-0b27132c7e87', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b864f7-1314-41a6-954b-6dc4c5effa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b864f7-1314-41a6-954b-6dc4c5effa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614d4280-838e-44c9-9cf9-854b17148f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Volume 3df107c2-bc1c-4604-b35a-0b27132c7e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df107c2-bc1c-4604-b35a-0b27132c7e87', 'volume_size': 1} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22a92540-2f24-40ba-88b7-dcca94d52203,created_at=2026-09-25T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467204339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22a92540-2f24-40ba-88b7-dcca94d52203,host='devstack@QuobyteHD#QuobyteHD',id=3df107c2-bc1c-4604-b35a-0b27132c7e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:17Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(157b5783-ec63-49be-9519-98f20ed20b19),volume_type_id=157b5783-ec63-49be-9519-98f20ed20b19)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Creating volume 3df107c2-bc1c-4604-b35a-0b27132c7e87 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:17 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:17 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 1073741824 Sep 25 12:44:17 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (0c545ce1-0c87-4e49-b3d8-c806bd19b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba71d5d-8c9b-4bbe-bf97-b0c173918713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba71d5d-8c9b-4bbe-bf97-b0c173918713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391426843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,host='devstack@QuobyteHD#QuobyteHD',id=7caadc27-0bcc-4a98-8eaf-56733182ca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:17Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5bbc57-165d-4d47-b4ae-59571e3d3397),volume_type_id=df5bbc57-165d-4d47-b4ae-59571e3d3397)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88632753-aa35-4c97-9245-ed4b5b3cb878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88632753-aa35-4c97-9245-ed4b5b3cb878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffe9f0-4374-4ae2-a44f-b84c3aa92d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffe9f0-4374-4ae2-a44f-b84c3aa92d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7caadc27-0bcc-4a98-8eaf-56733182ca53', 'volume_name': 'volume-7caadc27-0bcc-4a98-8eaf-56733182ca53', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdcf4b-3bf8-4dc8-a044-6c73470db649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdcf4b-3bf8-4dc8-a044-6c73470db649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638a1454-743a-42e7-9d4d-ba88f0152365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Volume 7caadc27-0bcc-4a98-8eaf-56733182ca53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7caadc27-0bcc-4a98-8eaf-56733182ca53', 'volume_size': 1} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:17 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 1073741824" returned: 0 in 0.627s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:17 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 Sep 25 12:44:17 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:18 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,created_at=2026-09-25T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391426843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,host='devstack@QuobyteHD#QuobyteHD',id=7caadc27-0bcc-4a98-8eaf-56733182ca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:17Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5bbc57-165d-4d47-b4ae-59571e3d3397),volume_type_id=df5bbc57-165d-4d47-b4ae-59571e3d3397)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Creating volume 7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:18 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614d4280-838e-44c9-9cf9-854b17148f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df107c2-bc1c-4604-b35a-0b27132c7e87', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a20c7a8-18e0-43a3-8360-f752b8718748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:18 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 1073741824 Sep 25 12:44:18 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Volume volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 (3df107c2-bc1c-4604-b35a-0b27132c7e87): created successfully Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a20c7a8-18e0-43a3-8360-f752b8718748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (3c22ab2e-7da5-4a66-8406-e4726c9e5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cf6ff865-c719-4ba3-9c4e-77c6f3cd32db tempest-GroupsTest-1243025194 None] Created volume successfully. Sep 25 12:44:18 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 1073741824" returned: 0 in 0.596s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:18 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 Sep 25 12:44:18 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:19 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53" returned: 0 in 0.420s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.828s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638a1454-743a-42e7-9d4d-ba88f0152365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7caadc27-0bcc-4a98-8eaf-56733182ca53', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a737efdc-dc75-4290-b9dd-d25d696e3eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Creating offline snapshot b53bd054-fd62-4713-be91-b68c91a78626 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Volume volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 (7caadc27-0bcc-4a98-8eaf-56733182ca53): created successfully Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a737efdc-dc75-4290-b9dd-d25d696e3eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (0c545ce1-0c87-4e49-b3d8-c806bd19b4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2414731-fc4a-438d-87f6-91ff44f9ce1a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7cada557-648e-4671-9d19-1f83c948e51c tempest-GroupSnapshotsTest-52754260 None] Created volume successfully. Sep 25 12:44:19 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:19 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:19 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.558s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:20 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 1G Sep 25 12:44:20 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Acquiring lock "cinder-quobyte-3df107c2-bc1c-4604-b35a-0b27132c7e87" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-3df107c2-bc1c-4604-b35a-0b27132c7e87" acquired by "delete_volume" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bab0a8-dcc1-4a73-bd28-00f1c3ee020d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:20 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 Sep 25 12:44:20 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:20 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 1G" returned: 0 in 0.661s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:20 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 Sep 25 12:44:20 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:20 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87" returned: 0 in 0.597s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:20 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87 Sep 25 12:44:20 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:21 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626" returned: 0 in 0.447s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:21 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 is being set with open permissions: ugo+rw Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:21 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 Sep 25 12:44:21 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:21 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3df107c2-bc1c-4604-b35a-0b27132c7e87" returned: 0 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-3df107c2-bc1c-4604-b35a-0b27132c7e87" released by "delete_volume" :: held 1.187s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (7c720954-1df7-46fd-9d42-0650b662cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fe640a-4538-43ba-ae9e-b17c844401e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fe640a-4538-43ba-ae9e-b17c844401e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905574182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,host='devstack@QuobyteHD#QuobyteHD',id=06b39279-a28f-4bad-960c-b58ef465a1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:21Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5bbc57-165d-4d47-b4ae-59571e3d3397),volume_type_id=df5bbc57-165d-4d47-b4ae-59571e3d3397)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb68c9e9-cc49-45d8-9e06-1a7035b4eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb68c9e9-cc49-45d8-9e06-1a7035b4eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df0ba3-61c3-41aa-bfae-771ef2a13d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3df0ba3-61c3-41aa-bfae-771ef2a13d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b39279-a28f-4bad-960c-b58ef465a1a2', 'volume_name': 'volume-06b39279-a28f-4bad-960c-b58ef465a1a2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b4f061-0cdb-417f-a589-1e028a764a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b4f061-0cdb-417f-a589-1e028a764a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0723d234-23f8-47b1-927b-c7109ab0c831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Volume 06b39279-a28f-4bad-960c-b58ef465a1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b39279-a28f-4bad-960c-b58ef465a1a2', 'volume_size': 1} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:21 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,created_at=2026-09-25T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905574182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=059a6cdd-9cc0-4c65-8d49-edabda458bee,host='devstack@QuobyteHD#QuobyteHD',id=06b39279-a28f-4bad-960c-b58ef465a1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:21Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df5bbc57-165d-4d47-b4ae-59571e3d3397),volume_type_id=df5bbc57-165d-4d47-b4ae-59571e3d3397)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Creating volume 06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:21 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Created reservations ['0f4d619e-e0ec-48fe-a81a-d908dc79deb3'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:21 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 1073741824 Sep 25 12:44:21 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e46c341a-e44a-4fa9-89fd-39d6d0baf1a9 tempest-SnapshotsActionsTest-1882658921 None] Create snapshot completed successfully Sep 25 12:44:21 devstack cinder-volume[87094]: WARNING cinder.quota [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1024295962 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1024295962, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:21 devstack cinder-volume[87094]: WARNING cinder.quota [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1024295962 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1024295962, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Created reservations ['2f660d1c-c4d3-4b91-9bb8-b62125f824e6', '793a44bf-1b7b-4e41-8ff1-f0d35992b0d8', '9299021a-1b46-4aa7-81d2-9518ff8c40a1', '73113eaa-52eb-40d4-8210-6fc77d2be85e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:21 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:21 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:22 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.381s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cb08d90f-5c04-4308-8e34-7bb02f6861de tempest-GroupsTest-1243025194 None] Delete group completed successfully. Sep 25 12:44:22 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 1073741824" returned: 0 in 0.685s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:22 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 Sep 25 12:44:22 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:22 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2" returned: 0 in 0.473s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0723d234-23f8-47b1-927b-c7109ab0c831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b39279-a28f-4bad-960c-b58ef465a1a2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc514a1-bffb-4712-a0f5-612a8cff5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Volume volume-06b39279-a28f-4bad-960c-b58ef465a1a2 (06b39279-a28f-4bad-960c-b58ef465a1a2): created successfully Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc514a1-bffb-4712-a0f5-612a8cff5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (7c720954-1df7-46fd-9d42-0650b662cc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2ece9f04-a84a-413a-90ca-2c0e3c3a3e87 tempest-GroupSnapshotsTest-52754260 None] Created volume successfully. Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-b53bd054-fd62-4713-be91-b68c91a78626-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-b53bd054-fd62-4713-be91-b68c91a78626-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Created reservations ['4d3fb470-6b1c-49bf-a620-b4cefa10a58b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Acquiring lock "cinder-quobyte-b53bd054-fd62-4713-be91-b68c91a78626" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-b53bd054-fd62-4713-be91-b68c91a78626" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Deleting offline snapshot b53bd054-fd62-4713-be91-b68c91a78626 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] snapshot_file for this snap is: volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260cb32-85ab-4dc4-9914-bc6fa76f17f9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:23 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:23 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:23 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 Sep 25 12:44:23 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:23 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.354s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8419c422-5d7a-4df7-bc46-5ed36e5f8025 tempest-GroupsTest-1243025194 None] Delete group completed successfully. Sep 25 12:44:23 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626" returned: 0 in 0.506s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8f572-56ec-4890-a855-e3dc6b25d283]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:23 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:23 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:24 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.563s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:24 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 Sep 25 12:44:24 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6386f040-3cbf-4f03-bf73-d3a983037e1f tempest-GroupSnapshotsTest-52754260 None] Update group completed successfully. Sep 25 12:44:24 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:24 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626 Sep 25 12:44:24 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8875049c-08ff-47de-9780-31a41d7d7688 tempest-GroupsTest-1243025194 None] Group tempest-GroupsTest-Group-2031199247: creating Sep 25 12:44:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8875049c-08ff-47de-9780-31a41d7d7688 tempest-GroupsTest-1243025194 None] Group tempest-GroupsTest-Group-2031199247: created successfully Sep 25 12:44:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8875049c-08ff-47de-9780-31a41d7d7688 tempest-GroupsTest-1243025194 None] Create group completed successfully. Sep 25 12:44:25 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.b53bd054-fd62-4713-be91-b68c91a78626" returned: 0 in 0.348s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-b53bd054-fd62-4713-be91-b68c91a78626" released by "_delete_snapshot" :: held 2.057s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_snapshot" :: held 2.088s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:25 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Created reservations ['13bf5af2-7af3-416f-95dc-8421ea80cdf5', '7fe26aa3-0da8-463d-a1e5-6b4a5964c8a7', 'b1309c17-c76b-461b-b0a3-6d0930dddb09', '68bf142a-9cca-4d95-b558-f42918cd06c5'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Delete snapshot completed successfully. Sep 25 12:44:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-484b77c4-d0fd-4f6d-99b0-2ffafa1cc0ca tempest-SnapshotsActionsTest-615695261 None] Lock "cinder-b53bd054-fd62-4713-be91-b68c91a78626-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8adb119e-94aa-4173-a968-b5d71ceb4065 tempest-GroupSnapshotsTest-52754260 None] Update group completed successfully. Sep 25 12:44:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (63ab1fa2-1066-4658-ac28-0ca4b7e7a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b300975-1180-4ef6-a1cd-3e079d6edb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b300975-1180-4ef6-a1cd-3e079d6edb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1725985113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,host='devstack@QuobyteHD#QuobyteHD',id=dd1e5c3b-8526-460e-95b9-c63c6823d6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:27Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a716e57-1e21-40de-8369-02db849ce04d),volume_type_id=3a716e57-1e21-40de-8369-02db849ce04d)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165ba56b-0246-4835-957c-c2cfda330a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165ba56b-0246-4835-957c-c2cfda330a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15661c5-f57f-4436-b96e-df6b2e84be47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15661c5-f57f-4436-b96e-df6b2e84be47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1e5c3b-8526-460e-95b9-c63c6823d6a6', 'volume_name': 'volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce15fa6-d9c4-4420-aa73-30acb4048137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce15fa6-d9c4-4420-aa73-30acb4048137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e5d0b-8a77-4222-8c20-d133fc1f0726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Volume dd1e5c3b-8526-460e-95b9-c63c6823d6a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6', 'volume_size': 1} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,created_at=2026-09-25T10:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1725985113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,host='devstack@QuobyteHD#QuobyteHD',id=dd1e5c3b-8526-460e-95b9-c63c6823d6a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:27Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a716e57-1e21-40de-8369-02db849ce04d),volume_type_id=3a716e57-1e21-40de-8369-02db849ce04d)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Creating volume dd1e5c3b-8526-460e-95b9-c63c6823d6a6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:27 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "cinder-2f115daf-a34e-4379-a6e1-e48459a51018-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:27 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-12ba3d86-befc-431b-86de-9951af8f7e2e tempest-GroupSnapshotsTest-52754260 None] Update group completed successfully. Sep 25 12:44:27 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 1073741824 Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-2f115daf-a34e-4379-a6e1-e48459a51018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:27 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "cinder-quobyte-2f115daf-a34e-4379-a6e1-e48459a51018" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-2f115daf-a34e-4379-a6e1-e48459a51018" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Deleting offline snapshot 2f115daf-a34e-4379-a6e1-e48459a51018 of volume 61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] snapshot_file for this snap is: volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b364f-2291-4a54-9873-5e6833558c8e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:27 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:27 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 1073741824" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:27 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.586s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61799b51-2027-450b-bc39-9112415067fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f2762-bec3-4f71-ac92-9e890da73a6d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 Sep 25 12:44:27 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:28 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb Sep 25 12:44:28 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:28 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897e5d0b-8a77-4222-8c20-d133fc1f0726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42385d19-f9e3-4945-b973-68795c53bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Volume volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 (dd1e5c3b-8526-460e-95b9-c63c6823d6a6): created successfully Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42385d19-f9e3-4945-b973-68795c53bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (63ab1fa2-1066-4658-ac28-0ca4b7e7a34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-213503f4-0527-4794-b99f-98bab11c5d1f tempest-GroupsTest-1243025194 None] Created volume successfully. Sep 25 12:44:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bd06775b-4204-4dea-afb2-be80e5435980 tempest-GroupSnapshotsTest-52754260 None] Update group completed successfully. Sep 25 12:44:28 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:28 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:28 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:29 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.503s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:29 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018 Sep 25 12:44:29 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:29 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb.2f115daf-a34e-4379-a6e1-e48459a51018" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-2f115daf-a34e-4379-a6e1-e48459a51018" released by "_delete_snapshot" :: held 2.343s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_snapshot" :: held 2.382s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Created reservations ['b969aed2-d60c-4a90-a637-fda5b9678c16', '647944dd-d199-420a-babe-0d36faeec529', '67b67999-7be7-43bd-927a-77aa26905997', 'c5b45aa7-c5d6-41f5-b49c-d6a0afea2919'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Delete snapshot completed successfully. Sep 25 12:44:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d033f21f-806a-452d-b7a8-f423b1d5b742 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-2f115daf-a34e-4379-a6e1-e48459a51018-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] GroupSnapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: creating. Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Group snapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: creating. {{(pid=87094) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Creating offline snapshot 58a112b1-3449-4615-b98d-34a484f7933b of volume 06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdea6b9-3699-4554-8a0f-bb1d5e65bb74]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (1ee82fbf-3774-45f2-90a2-1343774e9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472f9156-db53-4ef9-aa5e-8c993c5e9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472f9156-db53-4ef9-aa5e-8c993c5e9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873462572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,host='devstack@QuobyteHD#QuobyteHD',id=d783e1ec-11b7-453a-a9d6-04e893fb83a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:30Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a716e57-1e21-40de-8369-02db849ce04d),volume_type_id=3a716e57-1e21-40de-8369-02db849ce04d)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788c41f4-de67-4ecf-963d-9b649c39fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788c41f4-de67-4ecf-963d-9b649c39fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76de635-49ec-4c15-afb1-11d38f2c5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76de635-49ec-4c15-afb1-11d38f2c5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd783e1ec-11b7-453a-a9d6-04e893fb83a9', 'volume_name': 'volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:30 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 Sep 25 12:44:30 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c6866b-a15d-403a-9ce2-f8a2b2b040d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c6866b-a15d-403a-9ce2-f8a2b2b040d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9ddaeb-3dac-4317-bf66-8ea50096cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Volume d783e1ec-11b7-453a-a9d6-04e893fb83a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9', 'volume_size': 1} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "cinder-61799b51-2027-450b-bc39-9112415067fb-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-61799b51-2027-450b-bc39-9112415067fb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3a5b89-8088-4d89-ac83-0c1528443b72]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:31 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2" returned: 0 in 0.652s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:31 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb Sep 25 12:44:31 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:31 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b 1G Sep 25 12:44:31 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:31 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb" returned: 0 in 0.537s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:31 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb Sep 25 12:44:31 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:31 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b 1G" returned: 0 in 0.547s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b39279-a28f-4bad-960c-b58ef465a1a2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:31 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b39279-a28f-4bad-960c-b58ef465a1a2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b Sep 25 12:44:31 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:31 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-61799b51-2027-450b-bc39-9112415067fb" returned: 0 in 0.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-quobyte-61799b51-2027-450b-bc39-9112415067fb" released by "delete_volume" :: held 1.003s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Created reservations ['efe8eeb8-e640-4719-aed7-de1a2bf1fca0', 'd0f30e85-3493-48c2-931f-5d6662ff11b6', '32757982-fea5-45a6-9314-a7e90eb6c35e', '6d84421a-24a1-4bdb-b61e-4592ffc63410'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:32 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06b39279-a28f-4bad-960c-b58ef465a1a2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b" returned: 0 in 0.540s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:32 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:32 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:32 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:32 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b Sep 25 12:44:32 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Flow 'volume_create_manager' (5a5fd743-2b3f-447b-9b33-b6657845bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cc8ba1-a12d-47bc-8f01-875d33e568eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cc8ba1-a12d-47bc-8f01-875d33e568eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-940897864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ac2dff-b60e-4517-b939-3f6b24a31823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a830a03e47bf4b7e85cf0c327746d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:32Z,use_quota=True,user_id='6cbe2d95547d4800a2eda1232e4bb0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754d6081-4a53-4cbe-a981-ed8dd2cc8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754d6081-4a53-4cbe-a981-ed8dd2cc8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1319a-927a-4e68-96ea-388c8b3519f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:44:32 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.338s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:32 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b" returned: 0 in 0.333s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Deleted volume successfully. Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9e9e9bb-01fd-4047-93d4-9ed7dc084d65 tempest-SnapshotsActionsTest-1882658921 None] Lock "cinder-61799b51-2027-450b-bc39-9112415067fb-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:32 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info Sep 25 12:44:32 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d1319a-927a-4e68-96ea-388c8b3519f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3ac2dff-b60e-4517-b939-3f6b24a31823', 'volume_name': 'volume-f3ac2dff-b60e-4517-b939-3f6b24a31823', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884f7283-b41a-4e63-a412-c60d504e552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884f7283-b41a-4e63-a412-c60d504e552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf78d2d-c086-4b53-a698-0ff63283e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:32 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Volume f3ac2dff-b60e-4517-b939-3f6b24a31823: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3ac2dff-b60e-4517-b939-3f6b24a31823', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Trying to clone f3ac2dff-b60e-4517-b939-3f6b24a31823 from image d090291b-21f1-4593-a719-dd6e6ea3f284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:44:32 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:32 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:32 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info Sep 25 12:44:32 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:44:33 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[041036f3-2798-4f3f-b6d6-fb1b5e33ca23]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:33 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.info" returned: 0 in 0.366s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.933s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Creating offline snapshot 9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 of volume 7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:33 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD Sep 25 12:44:33 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113099e-131f-4d77-9c0b-f5707f668c59]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:33 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 Sep 25 12:44:33 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:33 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 is fetched for user 6cbe2d95547d4800a2eda1232e4bb0ca. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa539190-a403-4c3c-927c-f00cc25a6bc8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:33 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53" returned: 0 in 0.450s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:33 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD Sep 25 12:44:33 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:33 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 1G Sep 25 12:44:33 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:34 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:34 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 1G" returned: 0 in 0.581s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:34 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 Sep 25 12:44:34 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:34 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" returned: 0 in 0.388s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:34 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:34 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 Sep 25 12:44:34 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:35 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" returned: 0 in 0.306s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:35 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info Sep 25 12:44:35 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:35 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info" returned: 0 in 0.372s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:35 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:35 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info Sep 25 12:44:35 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:35 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.info" returned: 0 in 0.446s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.274s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,created_at=2026-09-25T10:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873462572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9137e08-e2ea-430d-988f-8a23fe78e8c3,host='devstack@QuobyteHD#QuobyteHD',id=d783e1ec-11b7-453a-a9d6-04e893fb83a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285bb29ff2bc44039a7339dc599f2825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:30Z,use_quota=True,user_id='ad97cf5f0f5e4cdbbd43b323241f7f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a716e57-1e21-40de-8369-02db849ce04d),volume_type_id=3a716e57-1e21-40de-8369-02db849ce04d)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Creating volume d783e1ec-11b7-453a-a9d6-04e893fb83a9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:35 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:36 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 1073741824 Sep 25 12:44:36 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0007694a-2cab-4fa5-aeb4-dd4f4b74f6e4 tempest-GroupSnapshotsTest-52754260 None] group_snapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: created successfully Sep 25 12:44:36 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 1073741824" returned: 0 in 0.644s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:36 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 Sep 25 12:44:36 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:36 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.873s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-940897864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ac2dff-b60e-4517-b939-3f6b24a31823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a830a03e47bf4b7e85cf0c327746d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:32Z,use_quota=True,user_id='6cbe2d95547d4800a2eda1232e4bb0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Creating volume f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] group_snapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: deleting Sep 25 12:44:37 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1073741824 Sep 25 12:44:37 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9ddaeb-3dac-4317-bf66-8ea50096cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab676b-6d75-46a5-9305-7a955c71b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] group_snapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: deleting {{(pid=87094) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:44:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Volume volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 (d783e1ec-11b7-453a-a9d6-04e893fb83a9): created successfully Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab676b-6d75-46a5-9305-7a955c71b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Flow 'volume_create_manager' (1ee82fbf-3774-45f2-90a2-1343774e9924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-58a112b1-3449-4615-b98d-34a484f7933b" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-63fff772-d75a-4642-9346-71f831919687 tempest-GroupsTest-1243025194 None] Created volume successfully. Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-58a112b1-3449-4615-b98d-34a484f7933b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Deleting offline snapshot 58a112b1-3449-4615-b98d-34a484f7933b of volume 06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] snapshot_file for this snap is: volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b632bd-7ab6-4884-9069-1f4fd1793f9f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:37 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b Sep 25 12:44:37 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1073741824" returned: 0 in 0.773s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:37 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 Sep 25 12:44:37 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06b39279-a28f-4bad-960c-b58ef465a1a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4491fce-f10d-4fb4-8940-d0b5071c41e1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:38 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 Sep 25 12:44:38 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:38 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823" returned: 0 in 0.424s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Attempting download of d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume f3ac2dff-b60e-4517-b939-3f6b24a31823. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d63713-889b-4d0e-b070-c6786b55c5a9]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f6d8728d-282b-4f8a-b840-e755a334a6c3 tempest-GroupsTest-1243025194 None] Update group completed successfully. Sep 25 12:44:38 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb Sep 25 12:44:38 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:38 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2" returned: 0 in 0.730s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:38 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b Sep 25 12:44:38 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:38 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb Sep 25 12:44:39 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:39 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b" returned: 0 in 0.462s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b Sep 25 12:44:39 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:39 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb" returned: 1 in 0.382s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_syi25bdb' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[13136da4-a2c9-4a6b-9d7d-55932cd68349]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD Sep 25 12:44:39 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:39 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2.58a112b1-3449-4615-b98d-34a484f7933b" returned: 0 in 0.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-58a112b1-3449-4615-b98d-34a484f7933b" released by "_delete_snapshot" :: held 2.278s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" released by "delete_snapshot" :: held 2.329s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Deleting offline snapshot 9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 of volume 7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] snapshot_file for this snap is: volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ce9276-a404-47b0-80ff-0db39740bb36]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] d090291b-21f1-4593-a719-dd6e6ea3f284 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:44:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 Sep 25 12:44:39 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:40 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 Sep 25 12:44:40 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d01223bc-8c70-49c6-a050-9c8d6efd549c tempest-GroupsTest-1243025194 None] Update group completed successfully. Sep 25 12:44:40 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" returned: 0 in 0.590s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7caadc27-0bcc-4a98-8eaf-56733182ca53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce19c43-da3c-42d9-ae41-084d7a968a1c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:40 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 Sep 25 12:44:40 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:40 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53" returned: 0 in 0.551s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:41 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 Sep 25 12:44:41 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:41 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" returned: 0 in 0.688s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:41 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4 Sep 25 12:44:41 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Acquiring lock "cinder-quobyte-d783e1ec-11b7-453a-a9d6-04e893fb83a9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-d783e1ec-11b7-453a-a9d6-04e893fb83a9" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:42 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53.9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" returned: 0 in 0.477s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ed54f3-7e7e-42d3-a176-dc2677f5588e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-9cffd8f3-95d0-4fe0-938d-9c4b1e979fa4" released by "_delete_snapshot" :: held 2.482s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" released by "delete_snapshot" :: held 2.528s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:42 devstack cinder-volume[87094]: WARNING cinder.quota [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-231579683 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-231579683, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:42 devstack cinder-volume[87094]: WARNING cinder.quota [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-231579683 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-231579683, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:42 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 Sep 25 12:44:42 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Flow 'volume_create_manager' (7171d0a7-dd1b-439e-8d68-8a3bcd1a2c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b564da8-fbf3-4fb6-8d11-34621214a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b564da8-fbf3-4fb6-8d11-34621214a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1349658255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbdbf55-21df-47c6-8727-d65caecda89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228ace668ac44a30b5ae5cbeea074fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:42Z,use_quota=True,user_id='58c4a78b021d4dedbb3cbb8097c82835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7b81e0-7108-4b5f-8383-f9bddef51a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7b81e0-7108-4b5f-8383-f9bddef51a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a2ada-9be1-4909-8a17-e414e33436d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a2ada-9be1-4909-8a17-e414e33436d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbdbf55-21df-47c6-8727-d65caecda89a', 'volume_name': 'volume-6cbdbf55-21df-47c6-8727-d65caecda89a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad7155e-3e80-49b6-a616-f9905849bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad7155e-3e80-49b6-a616-f9905849bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796e4528-62ee-4d30-9a58-626701e3fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Volume 6cbdbf55-21df-47c6-8727-d65caecda89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbdbf55-21df-47c6-8727-d65caecda89a', 'volume_size': 1} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1349658255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbdbf55-21df-47c6-8727-d65caecda89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228ace668ac44a30b5ae5cbeea074fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:42Z,use_quota=True,user_id='58c4a78b021d4dedbb3cbb8097c82835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Creating volume 6cbdbf55-21df-47c6-8727-d65caecda89a {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:42 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:42 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823" returned: 0 in 2.800s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_btqi31rudevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:44:42 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Converted 112.00 MB image at 39.97 MB/s Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:42 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a 1073741824 Sep 25 12:44:42 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Created reservations ['1eaf0441-22ff-4b4f-bcad-9286d343dbf7', '4388160d-4890-4409-aa89-f118aba6296f', '40e687d1-a150-464b-8607-9ccd8020688f', 'f7aa9607-4b54-49d7-9030-dea2b366849c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:42 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1G Sep 25 12:44:42 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:42 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] Created reservations ['8026a66a-c131-4173-a83c-cd90f847decc', '9ffddf1d-8494-4526-bfe3-1c3866addc85', '4a34c0e4-fff5-4a86-aa80-fe445c930a6b', '310452ff-0a1d-4ce3-a244-694a0b05cad2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:43 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9" returned: 0 in 0.821s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9 Sep 25 12:44:43 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-79a5260a-1f58-4a95-b9d4-6143731b0a2e tempest-GroupSnapshotsTest-52754260 None] group_snapshot 0c7841ba-7a7f-48fe-8fef-ae408144f3c2: deleted successfully Sep 25 12:44:43 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 1G" returned: 0 in 0.577s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Downloaded image d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume f3ac2dff-b60e-4517-b939-3f6b24a31823 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 for user 6cbe2d95547d4800a2eda1232e4bb0ca is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Marking volume f3ac2dff-b60e-4517-b939-3f6b24a31823 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Copying metadata from image d090291b-21f1-4593-a719-dd6e6ea3f284 to f3ac2dff-b60e-4517-b939-3f6b24a31823. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Creating volume glance metadata for volume f3ac2dff-b60e-4517-b939-3f6b24a31823 backed by image d090291b-21f1-4593-a719-dd6e6ea3f284 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:44:43 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf78d2d-c086-4b53-a698-0ff63283e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ac2dff-b60e-4517-b939-3f6b24a31823', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7a14a4-8894-41e9-956a-072b5fe299a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d783e1ec-11b7-453a-a9d6-04e893fb83a9" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a 1073741824" returned: 0 in 0.818s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Volume volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 (f3ac2dff-b60e-4517-b939-3f6b24a31823): created successfully Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7a14a4-8894-41e9-956a-072b5fe299a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Flow 'volume_create_manager' (5a5fd743-2b3f-447b-9b33-b6657845bc23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-d783e1ec-11b7-453a-a9d6-04e893fb83a9" released by "delete_volume" :: held 1.364s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Acquiring lock "cinder-quobyte-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b63223a1-7e3d-4ae4-b31f-506ae6a4d074 tempest-VolumesImageMetadata-1445111369 None] Created volume successfully. Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b8a3f7-67cb-4f3f-bc8c-c13f262b463f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a Sep 25 12:44:43 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 Sep 25 12:44:43 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796e4528-62ee-4d30-9a58-626701e3fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbdbf55-21df-47c6-8727-d65caecda89a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7d3ca9-9dfb-4dd2-818c-9c0ef55b17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:43 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Volume volume-6cbdbf55-21df-47c6-8727-d65caecda89a (6cbdbf55-21df-47c6-8727-d65caecda89a): created successfully Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7d3ca9-9dfb-4dd2-818c-9c0ef55b17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Flow 'volume_create_manager' (7171d0a7-dd1b-439e-8d68-8a3bcd1a2c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f129c206-b248-4f63-9d46-51bfbf1e8457 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Created volume successfully. Sep 25 12:44:44 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:44 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6 Sep 25 12:44:44 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:44 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "cinder-quobyte-dd1e5c3b-8526-460e-95b9-c63c6823d6a6" released by "delete_volume" :: held 0.884s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Created reservations ['0a6149b4-f2c9-42c5-b913-749fd0dcfed0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:44 devstack cinder-volume[87094]: WARNING cinder.quota [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1420985580 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1420985580, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:44 devstack cinder-volume[87094]: WARNING cinder.quota [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1420985580 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1420985580, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Created reservations ['b0b1ba31-e80a-41e7-a31e-e692c8d9385b', '18b9db2f-8063-4695-b79a-d075c4fbd460', '34bcec35-4a4e-4019-9995-4413208ad9c0', '8fdea855-d2ef-435e-99fe-0d116140e935'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c16625-dab2-4f0d-96a0-4d79656350bb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Created reservations ['10977c62-73fe-4ec9-8910-1cc9669053d5', 'c37c08ba-ffc8-4dc4-9ae8-dce71b09a80d', '5ca68130-2721-44b6-bb43-fbf3ca205858', 'eba9ffbc-59fd-48b0-83fd-d54ffe8323f2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:44 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 Sep 25 12:44:44 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:45 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:45 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Acquiring lock "cinder-f3ac2dff-b60e-4517-b939-3f6b24a31823-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "cinder-f3ac2dff-b60e-4517-b939-3f6b24a31823-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:45 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2" returned: 0 in 0.675s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Acquiring lock "cinder-quobyte-f3ac2dff-b60e-4517-b939-3f6b24a31823" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:45 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2 Sep 25 12:44:45 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "cinder-quobyte-f3ac2dff-b60e-4517-b939-3f6b24a31823" acquired by "delete_volume" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:45 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.466s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f8a4b-c5dc-4877-aa43-deb4cb010b1b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:45 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-572a6eac-175e-4507-9a5b-7e0ab102fe1d tempest-GroupsTest-1243025194 None] Delete group completed successfully. Sep 25 12:44:45 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 Sep 25 12:44:45 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:45 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-06b39279-a28f-4bad-960c-b58ef465a1a2" returned: 0 in 0.373s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-06b39279-a28f-4bad-960c-b58ef465a1a2" released by "delete_volume" :: held 1.150s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b72eb6-955e-4c54-9e2f-51899df6b78d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 Sep 25 12:44:46 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823" returned: 0 in 0.646s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823 Sep 25 12:44:46 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Acquiring lock "cinder-6cbdbf55-21df-47c6-8727-d65caecda89a-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "cinder-6cbdbf55-21df-47c6-8727-d65caecda89a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Acquiring lock "cinder-quobyte-6cbdbf55-21df-47c6-8727-d65caecda89a" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "cinder-quobyte-6cbdbf55-21df-47c6-8727-d65caecda89a" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[65989989-ad9c-4925-97b2-5f9480d08db0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53" returned: 0 in 0.784s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53 Sep 25 12:44:46 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f3ac2dff-b60e-4517-b939-3f6b24a31823" returned: 0 in 0.572s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "cinder-quobyte-f3ac2dff-b60e-4517-b939-3f6b24a31823" released by "delete_volume" :: held 1.322s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Created reservations ['64010322-3c65-4b97-a36d-457805272647', '2a99ffd3-98f5-447b-9d67-156995f8a902', 'de57c91b-b7bd-49eb-b02d-8b25572a5c2a', '6e53d40f-054e-40ad-bbff-54d8c79c4ace'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:46 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a Sep 25 12:44:46 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:47 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:47 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:47 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7caadc27-0bcc-4a98-8eaf-56733182ca53" returned: 0 in 0.442s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7caadc27-0bcc-4a98-8eaf-56733182ca53" released by "delete_volume" :: held 1.322s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:47 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:47 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:47 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a" returned: 0 in 0.688s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Created reservations ['980a00af-1a87-4269-83e5-47ac2f74f314'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:47 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a Sep 25 12:44:47 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:47 devstack cinder-volume[87094]: WARNING cinder.quota [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-231579683 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-231579683, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:47 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.538s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Deleted volume successfully. Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Created reservations ['77b1df5b-e4bb-4b5e-b910-dac94a337df7', '8b2445f0-3303-460d-8a99-0338587a642c', '6a0a13d5-aa4f-4f29-96d8-51c61f96413a', '8178a4ea-82fa-4f99-af06-33be17f572e7'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07dca502-c481-4f5b-9c85-83561795ec08 tempest-VolumesImageMetadata-1445111369 None] Lock "cinder-f3ac2dff-b60e-4517-b939-3f6b24a31823-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:47 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Created reservations ['2f98d045-cc8e-4f33-8d7a-ca0f1b6a45b6', '3877e6fd-a28a-4b12-bf31-2d871404f1cf', '82e9e576-78c5-4ca4-832e-082a82b4bee0', '0345a689-fd0a-4ec4-9826-bdf6c55d1338'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:47 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6cbdbf55-21df-47c6-8727-d65caecda89a" returned: 0 in 0.578s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "cinder-quobyte-6cbdbf55-21df-47c6-8727-d65caecda89a" released by "delete_volume" :: held 1.342s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Created reservations ['071efe35-7cbb-4ab3-85bb-0f0cc3bb923d', '02068628-7ef0-4765-9c6f-330f9879453f', 'e833f265-ca32-4711-bf2a-745760c5b61d', 'ea1b83cf-41f0-4149-9a0f-508b02f21dcb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:48 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:44:48 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:48 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ff5be681-b94e-434b-8023-e5bf88b1d87a tempest-GroupSnapshotsTest-52754260 None] Delete group completed successfully. Sep 25 12:44:48 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Deleted volume successfully. Sep 25 12:44:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76cdd32f-b61a-4a54-a7bc-b3ad74504825 tempest-VolumeQuotasNegativeTestJSON-1140538637 None] Lock "cinder-6cbdbf55-21df-47c6-8727-d65caecda89a-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5d06083e-6317-423f-b064-e0e19e5370ae tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-1226536364: creating Sep 25 12:44:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5d06083e-6317-423f-b064-e0e19e5370ae tempest-GroupSnapshotsTest-52754260 None] Group tempest-GroupSnapshotsTest-Group-1226536364: created successfully Sep 25 12:44:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5d06083e-6317-423f-b064-e0e19e5370ae tempest-GroupSnapshotsTest-52754260 None] Create group completed successfully. Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (14c57783-39db-4db2-aedb-966673f3ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c57e3f-9e06-4736-91db-9b2c1e7a17ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c57e3f-9e06-4736-91db-9b2c1e7a17ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088621554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ea3553c-a1de-4d2b-816f-3bbdc3bcb5d4,host='devstack@QuobyteHD#QuobyteHD',id=be486e0d-f738-4562-85e0-914640ab5ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:52Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(266ff519-61b4-44ab-8f3d-2ecb6b571a68),volume_type_id=266ff519-61b4-44ab-8f3d-2ecb6b571a68)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abf38a-07bb-488d-9cbd-2b8374f98516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abf38a-07bb-488d-9cbd-2b8374f98516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91b3d0-ea98-4f9f-a63e-c291ca607bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91b3d0-ea98-4f9f-a63e-c291ca607bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be486e0d-f738-4562-85e0-914640ab5ff7', 'volume_name': 'volume-be486e0d-f738-4562-85e0-914640ab5ff7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afac675-6f4e-40f6-8f37-8837163021a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afac675-6f4e-40f6-8f37-8837163021a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745e9655-1c96-433d-888b-b2ed2f799367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Volume be486e0d-f738-4562-85e0-914640ab5ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be486e0d-f738-4562-85e0-914640ab5ff7', 'volume_size': 1} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ea3553c-a1de-4d2b-816f-3bbdc3bcb5d4,created_at=2026-09-25T10:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088621554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ea3553c-a1de-4d2b-816f-3bbdc3bcb5d4,host='devstack@QuobyteHD#QuobyteHD',id=be486e0d-f738-4562-85e0-914640ab5ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80617861221d47c080f5818fca605c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:52Z,use_quota=True,user_id='36dcbd06e73e4006853b341c6b22a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(266ff519-61b4-44ab-8f3d-2ecb6b571a68),volume_type_id=266ff519-61b4-44ab-8f3d-2ecb6b571a68)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Creating volume be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:51 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:51 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 1073741824 Sep 25 12:44:51 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:52 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 1073741824" returned: 0 in 0.786s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:52 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 Sep 25 12:44:52 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:53 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7" returned: 0 in 0.479s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745e9655-1c96-433d-888b-b2ed2f799367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be486e0d-f738-4562-85e0-914640ab5ff7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be827fa-b55d-45d3-b7b6-e91b95930f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Volume volume-be486e0d-f738-4562-85e0-914640ab5ff7 (be486e0d-f738-4562-85e0-914640ab5ff7): created successfully Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be827fa-b55d-45d3-b7b6-e91b95930f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Flow 'volume_create_manager' (14c57783-39db-4db2-aedb-966673f3ba62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-032b7069-84bd-4fc6-931f-4f5beb31af2d tempest-GroupSnapshotsTest-52754260 None] Created volume successfully. Sep 25 12:44:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] GroupSnapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: creating. Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Group snapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: creating. {{(pid=87094) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Creating offline snapshot 7db7da45-cec0-4750-b91c-6e923ce58cb6 of volume be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9523d2d-c35d-4167-8c8c-967865f862f7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:54 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 Sep 25 12:44:54 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:55 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7" returned: 0 in 0.649s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:55 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 1G Sep 25 12:44:55 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:56 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 1G" returned: 0 in 0.833s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be486e0d-f738-4562-85e0-914640ab5ff7 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:56 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be486e0d-f738-4562-85e0-914640ab5ff7 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 Sep 25 12:44:56 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Flow 'volume_create_manager' (8121a5a0-34ec-4b4f-9619-c1edcef7b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d96d6d-1297-412b-9289-9f5efb62cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d96d6d-1297-412b-9289-9f5efb62cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1076815660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bc5959-a519-4f0e-9b4c-f56d909c4858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31fe4724a8dd419e878f81093cdcb62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:56Z,use_quota=True,user_id='3764aa9c6cf04c53b9387a09c28f7fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab7ff90-d459-4d40-a48b-d408ee2eec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab7ff90-d459-4d40-a48b-d408ee2eec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ea9acc-aa23-4b6a-aea6-b663fcf0b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ea9acc-aa23-4b6a-aea6-b663fcf0b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bc5959-a519-4f0e-9b4c-f56d909c4858', 'volume_name': 'volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f55501-0e37-4d9a-970d-2812f654e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f55501-0e37-4d9a-970d-2812f654e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc15058-e590-47ec-9634-dbc524ac7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Volume f8bc5959-a519-4f0e-9b4c-f56d909c4858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858', 'volume_size': 1} Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:56 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be486e0d-f738-4562-85e0-914640ab5ff7 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:56 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:56 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 Sep 25 12:44:56 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:57 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6" returned: 0 in 0.315s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:57 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info Sep 25 12:44:57 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:57 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info" returned: 0 in 0.352s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:57 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:57 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info Sep 25 12:44:57 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:57 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.info" returned: 0 in 0.380s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1076815660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bc5959-a519-4f0e-9b4c-f56d909c4858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31fe4724a8dd419e878f81093cdcb62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:56Z,use_quota=True,user_id='3764aa9c6cf04c53b9387a09c28f7fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Creating volume f8bc5959-a519-4f0e-9b4c-f56d909c4858 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:57 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:44:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:57 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 1073741824 Sep 25 12:44:57 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d4c17567-b2b6-4abc-a2cd-655959677a81 tempest-GroupSnapshotsTest-52754260 None] group_snapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: created successfully Sep 25 12:44:58 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 1073741824" returned: 0 in 0.670s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:58 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 Sep 25 12:44:58 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:58 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858" returned: 0 in 0.354s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc15058-e590-47ec-9634-dbc524ac7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1454b50c-eb0f-492a-8dc2-fbf6aa38efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Volume volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 (f8bc5959-a519-4f0e-9b4c-f56d909c4858): created successfully Sep 25 12:44:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1454b50c-eb0f-492a-8dc2-fbf6aa38efe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Flow 'volume_create_manager' (8121a5a0-34ec-4b4f-9619-c1edcef7b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-07da187d-e9ff-4235-ad91-8688916be1db tempest-AbsoluteLimitsTests-1018719088 None] Created volume successfully. Sep 25 12:44:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] group_snapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: deleting Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] group_snapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: deleting {{(pid=87094) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-7db7da45-cec0-4750-b91c-6e923ce58cb6" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7db7da45-cec0-4750-b91c-6e923ce58cb6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Deleting offline snapshot 7db7da45-cec0-4750-b91c-6e923ce58cb6 of volume be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] snapshot_file for this snap is: volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a785ea-9d42-45ad-b21f-c9883a686de9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:59 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 Sep 25 12:44:59 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:59 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6" returned: 0 in 0.509s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be486e0d-f738-4562-85e0-914640ab5ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33d3222-534d-420c-a82e-7dabb3ecdf49]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Acquiring lock "cinder-f8bc5959-a519-4f0e-9b4c-f56d909c4858-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "cinder-f8bc5959-a519-4f0e-9b4c-f56d909c4858-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:00 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 Sep 25 12:45:00 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Acquiring lock "cinder-quobyte-f8bc5959-a519-4f0e-9b4c-f56d909c4858" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Flow 'volume_create_manager' (25b38ff9-8ffd-4b4b-b531-857ecc37a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e48652-0eaf-4afb-9f82-05453587b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e48652-0eaf-4afb-9f82-05453587b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-253125513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10da2b90-4154-4a2b-90a3-a98cc03ebd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942445554f104ff38783e9deba5936f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:00Z,use_quota=True,user_id='5b5cf69d16cf43bea33a06628d5c6b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c063fee7-bde9-4bca-9388-95a593b9c982),volume_type_id=c063fee7-bde9-4bca-9388-95a593b9c982)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eefaee-7c8a-4b32-9df9-62b8c7059dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eefaee-7c8a-4b32-9df9-62b8c7059dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b0ce25-2a21-4001-b5fb-8f305f8b49b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b0ce25-2a21-4001-b5fb-8f305f8b49b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10da2b90-4154-4a2b-90a3-a98cc03ebd46', 'volume_name': 'volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d3d284-e4ab-4810-84d5-591b3e03b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d3d284-e4ab-4810-84d5-591b3e03b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a003c3-15cd-445b-814d-650ce5dff8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Volume 10da2b90-4154-4a2b-90a3-a98cc03ebd46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46', 'volume_size': 1} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-253125513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10da2b90-4154-4a2b-90a3-a98cc03ebd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942445554f104ff38783e9deba5936f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:00Z,use_quota=True,user_id='5b5cf69d16cf43bea33a06628d5c6b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c063fee7-bde9-4bca-9388-95a593b9c982),volume_type_id=c063fee7-bde9-4bca-9388-95a593b9c982)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Creating volume 10da2b90-4154-4a2b-90a3-a98cc03ebd46 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:00 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "cinder-quobyte-f8bc5959-a519-4f0e-9b4c-f56d909c4858" acquired by "delete_volume" :: waited 0.135s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:00 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 1073741824 Sep 25 12:45:00 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349e12f-31e8-4ed6-a47e-43e22e40f223]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:00 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7" returned: 0 in 0.568s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:00 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 Sep 25 12:45:00 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:00 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 Sep 25 12:45:00 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858" returned: 0 in 0.629s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 1073741824" returned: 0 in 0.710s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858 Sep 25 12:45:01 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6" returned: 0 in 0.583s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6 Sep 25 12:45:01 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 Sep 25 12:45:01 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f8bc5959-a519-4f0e-9b4c-f56d909c4858" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "cinder-quobyte-f8bc5959-a519-4f0e-9b4c-f56d909c4858" released by "delete_volume" :: held 1.065s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Created reservations ['c0d78358-0e0e-4344-b680-6e9991332ec8', '632a24af-8bbf-407a-a50e-1ee6dc03f2e8', '2970e7c8-ed27-43c4-a826-93baad3124f2', '0a61e1c9-96d1-42ae-adac-54e9fe92d565'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:01 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:01 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7.7db7da45-cec0-4750-b91c-6e923ce58cb6" returned: 0 in 0.428s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a003c3-15cd-445b-814d-650ce5dff8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd4a09a-32a1-4f04-8553-5be5a12a1cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-7db7da45-cec0-4750-b91c-6e923ce58cb6" released by "_delete_snapshot" :: held 2.297s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" released by "delete_snapshot" :: held 2.337s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:01 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Volume volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 (10da2b90-4154-4a2b-90a3-a98cc03ebd46): created successfully Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd4a09a-32a1-4f04-8553-5be5a12a1cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Flow 'volume_create_manager' (25b38ff9-8ffd-4b4b-b531-857ecc37a54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9bb32ffd-4fb3-422f-b2f7-369d72da232f tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Created volume successfully. Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:01 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack cinder-volume[87094]: WARNING cinder.quota [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1480962792 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1480962792, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:01 devstack cinder-volume[87094]: WARNING cinder.quota [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1480962792 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1480962792, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:01 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] Created reservations ['b4728e21-5efc-409c-9044-abe65641eeca', '663b951c-1c2b-4a54-be5f-7d7f0df393f9', 'f9efc1e0-1fc8-41e9-a881-3795a59e8d4a', '788d6678-c9d4-4abe-81ac-adddc6d0f0cf'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db134142-3720-4db9-9842-c2c83b9c89c7 tempest-GroupSnapshotsTest-52754260 None] group_snapshot 04712c6a-1f64-42ab-a1c1-a3d856544030: deleted successfully Sep 25 12:45:02 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Deleted volume successfully. Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d1203c8d-a1ed-49bd-8c61-55769febf595 tempest-AbsoluteLimitsTests-1018719088 None] Lock "cinder-f8bc5959-a519-4f0e-9b4c-f56d909c4858-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80fc7b-9124-4cbf-9c94-ca7da2a791af]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:02 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 Sep 25 12:45:02 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=206,cinder:SELECT=210,cinder:DELETE=10,cinder:INSERT=50 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:45:02 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=177,cinder:INSERT=59,cinder:UPDATE=200,cinder:DELETE=7 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:03 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:03 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:03 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7" returned: 0 in 0.673s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:03 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7 Sep 25 12:45:03 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:03 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.326s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a1bd5d2a-d100-49f6-8357-2063d85cd3f9 tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Retype volume completed successfully. Sep 25 12:45:03 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be486e0d-f738-4562-85e0-914640ab5ff7" returned: 0 in 0.331s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Lock "cinder-quobyte-be486e0d-f738-4562-85e0-914640ab5ff7" released by "delete_volume" :: held 1.162s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Created reservations ['82c55dd4-6d1e-4ca6-9ab1-a6c904dee871'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:03 devstack cinder-volume[87094]: WARNING cinder.quota [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1480962792 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1480962792, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Created reservations ['83335f2e-c6c6-439b-878e-5404ac86d083', '7f2a1c82-acc5-40cf-9212-d62d131894e0', '1c3612ab-bca9-4992-8dcf-ddf670826021', '329aed3c-c1a4-459b-b289-68e568666857'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:04 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:04 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:04 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5b0abdfd-032b-41a8-8ba5-6b803be5409e tempest-GroupSnapshotsTest-52754260 None] Delete group completed successfully. Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "cinder-10da2b90-4154-4a2b-90a3-a98cc03ebd46-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "cinder-10da2b90-4154-4a2b-90a3-a98cc03ebd46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "cinder-quobyte-10da2b90-4154-4a2b-90a3-a98cc03ebd46" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "cinder-quobyte-10da2b90-4154-4a2b-90a3-a98cc03ebd46" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa68ba-2fa8-4f44-9593-8f93d9670e27]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:04 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 Sep 25 12:45:04 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:05 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46" returned: 0 in 0.559s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:05 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46 Sep 25 12:45:05 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:05 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-10da2b90-4154-4a2b-90a3-a98cc03ebd46" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "cinder-quobyte-10da2b90-4154-4a2b-90a3-a98cc03ebd46" released by "delete_volume" :: held 1.037s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:05 devstack cinder-volume[87094]: WARNING cinder.quota [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:05 devstack cinder-volume[87094]: WARNING cinder.quota [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Created reservations ['611c2f24-ce7c-4d61-99fd-adc76c7e57ae', '87d86c8e-6896-44ed-a8b8-80f9fa96ff7e', '9fd6a6c9-a502-4bc3-a4a6-b8ab4ef1ea78', '170592d3-57ea-4ffa-924b-cfba5ebb3a22'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:05 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:05 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:06 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.317s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:06 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:06 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Deleted volume successfully. Sep 25 12:45:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3e6cdb28-e66c-4d32-bb8e-d322f713e6ea tempest-VolumeRetypeWithoutMigrationTest-1494372119 None] Lock "cinder-10da2b90-4154-4a2b-90a3-a98cc03ebd46-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Flow 'volume_create_manager' (0a5e4588-6e4e-4550-be06-96f4af0c08da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230c5c68-c2c5-4afc-8d53-837df0f52717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230c5c68-c2c5-4afc-8d53-837df0f52717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1109267694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2848f9b1-dfd7-4add-8d89-7169551b0d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589d60b079bf44209c225c8ca6651f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:09Z,use_quota=True,user_id='cbec3cff9abd40628fb60aaf5eeaf112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ea095f-42cb-4baf-b18e-3b48c256981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ea095f-42cb-4baf-b18e-3b48c256981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30161a0-6365-4993-bcf4-f6735812bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30161a0-6365-4993-bcf4-f6735812bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2848f9b1-dfd7-4add-8d89-7169551b0d76', 'volume_name': 'volume-2848f9b1-dfd7-4add-8d89-7169551b0d76', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c59b22-3761-428a-9c0a-6f5a36f90fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c59b22-3761-428a-9c0a-6f5a36f90fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f161450-e458-4494-85a3-88a9fe5b370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume 2848f9b1-dfd7-4add-8d89-7169551b0d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2848f9b1-dfd7-4add-8d89-7169551b0d76', 'volume_size': 1} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1109267694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2848f9b1-dfd7-4add-8d89-7169551b0d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589d60b079bf44209c225c8ca6651f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:09Z,use_quota=True,user_id='cbec3cff9abd40628fb60aaf5eeaf112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Creating volume 2848f9b1-dfd7-4add-8d89-7169551b0d76 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:08 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:08 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 1073741824 Sep 25 12:45:08 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:09 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 1073741824" returned: 0 in 0.706s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:09 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 Sep 25 12:45:09 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:10 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f161450-e458-4494-85a3-88a9fe5b370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2848f9b1-dfd7-4add-8d89-7169551b0d76', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db91491-7d53-431a-9b46-df98a56b28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:10 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 (2848f9b1-dfd7-4add-8d89-7169551b0d76): created successfully Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db91491-7d53-431a-9b46-df98a56b28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Flow 'volume_create_manager' (0a5e4588-6e4e-4550-be06-96f4af0c08da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-22f72b50-c6a7-4adc-819b-0ce22111f14f tempest-VolumeQuotasAdminTestJSON-1056922675 None] Created volume successfully. Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "cinder-2848f9b1-dfd7-4add-8d89-7169551b0d76-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "cinder-2848f9b1-dfd7-4add-8d89-7169551b0d76-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "cinder-quobyte-2848f9b1-dfd7-4add-8d89-7169551b0d76" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "cinder-quobyte-2848f9b1-dfd7-4add-8d89-7169551b0d76" acquired by "delete_volume" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9233a-4870-4ce4-a8a2-473284556dd2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:11 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 Sep 25 12:45:11 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:11 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76" returned: 0 in 0.675s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:11 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76 Sep 25 12:45:11 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (3ac20f7e-35f8-4ab6-ba77-f85dd17b5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604d34b8-6c79-44cd-97e5-1b312a403af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604d34b8-6c79-44cd-97e5-1b312a403af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-523934084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bc9fe5-c627-45a5-8f2d-5a2f3982a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300dff65aadd49d09dae2d13b34c0d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:12Z,use_quota=True,user_id='cc44964524bc4821b4b78e545c583fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60c4874-37a1-4ab3-87bf-1b8aeb62b76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60c4874-37a1-4ab3-87bf-1b8aeb62b76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af63d6-32cc-41fd-b9e6-0d4c87436775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af63d6-32cc-41fd-b9e6-0d4c87436775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bc9fe5-c627-45a5-8f2d-5a2f3982a501', 'volume_name': 'volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edffd3-f3aa-459f-85e7-0247c7d25e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edffd3-f3aa-459f-85e7-0247c7d25e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a09efdb-e167-4561-8f5c-1122ac0f83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:11 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501', 'volume_size': 1} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-523934084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bc9fe5-c627-45a5-8f2d-5a2f3982a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300dff65aadd49d09dae2d13b34c0d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:12Z,use_quota=True,user_id='cc44964524bc4821b4b78e545c583fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Creating volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:11 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:11 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 1073741824 Sep 25 12:45:11 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:12 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2848f9b1-dfd7-4add-8d89-7169551b0d76" returned: 0 in 0.414s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "cinder-quobyte-2848f9b1-dfd7-4add-8d89-7169551b0d76" released by "delete_volume" :: held 1.173s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Created reservations ['f2d78c9d-c65b-4c10-81db-4dde9716996c', 'cdb5f707-0d97-4655-ac4e-13ad97e5d005', 'b7b5de28-b214-4586-8ede-6bfa5729be8a', '650b370d-019c-418f-9691-1f1946c74b07'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:12 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:12 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:12 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 1073741824" returned: 0 in 0.712s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:12 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.306s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Deleted volume successfully. Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dd9947e8-7cbc-4039-a36d-3b9edd56f488 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "cinder-2848f9b1-dfd7-4add-8d89-7169551b0d76-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:12 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:12 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:13 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a09efdb-e167-4561-8f5c-1122ac0f83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a35398-300e-4d74-acf7-92e74305a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Volume volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 (12bc9fe5-c627-45a5-8f2d-5a2f3982a501): created successfully Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a35398-300e-4d74-acf7-92e74305a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (3ac20f7e-35f8-4ab6-ba77-f85dd17b5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-97253b9e-5537-4e73-a6d9-b469a5b3119b tempest-VolumesDeleteCascade-2134109787 None] Created volume successfully. Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Flow 'volume_create_manager' (6bd3e026-ac1c-460c-96db-75f8efcc9318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d090f458-68f4-44c2-8701-6b6f21656d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d090f458-68f4-44c2-8701-6b6f21656d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1428743874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab43bd21-18ed-44eb-a15a-d7dd75531aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589d60b079bf44209c225c8ca6651f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:14Z,use_quota=True,user_id='cbec3cff9abd40628fb60aaf5eeaf112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffc1b1a-38d0-4ee0-9630-572c49c41388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fffc1b1a-38d0-4ee0-9630-572c49c41388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a6bf0-f048-4c5f-a97b-38bc4aa7429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a6bf0-f048-4c5f-a97b-38bc4aa7429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab43bd21-18ed-44eb-a15a-d7dd75531aa9', 'volume_name': 'volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b538058-a083-43e2-9cff-c2f69a05cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b538058-a083-43e2-9cff-c2f69a05cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe8e1ac-2942-4e7c-b110-41ba61992bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume ab43bd21-18ed-44eb-a15a-d7dd75531aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9', 'volume_size': 1} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1428743874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab43bd21-18ed-44eb-a15a-d7dd75531aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589d60b079bf44209c225c8ca6651f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:14Z,use_quota=True,user_id='cbec3cff9abd40628fb60aaf5eeaf112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Creating volume ab43bd21-18ed-44eb-a15a-d7dd75531aa9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:14 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:14 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 1073741824 Sep 25 12:45:14 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:14 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 1073741824" returned: 0 in 0.625s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:14 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 Sep 25 12:45:14 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:15 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" returned: 0 in 0.317s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.870s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Creating offline snapshot 37d59c04-92bf-43b4-8c9f-71c7d86e86cb of volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe8e1ac-2942-4e7c-b110-41ba61992bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb71cdb-ee4f-4e02-8a11-c530b61ea20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a961d04e-8ceb-4232-b0a6-37aa18e99721]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Volume volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 (ab43bd21-18ed-44eb-a15a-d7dd75531aa9): created successfully Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb71cdb-ee4f-4e02-8a11-c530b61ea20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Flow 'volume_create_manager' (6bd3e026-ac1c-460c-96db-75f8efcc9318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-79a54633-f1ca-437a-b048-1d249ea8cf79 tempest-VolumeQuotasAdminTestJSON-1056922675 None] Created volume successfully. Sep 25 12:45:15 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:15 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:15 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.469s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:15 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb 1G Sep 25 12:45:15 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:16 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb 1G" returned: 0 in 0.699s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:16 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:16 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:16 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.455s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:16 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb is being set with open permissions: ugo+rw Sep 25 12:45:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:16 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:16 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-04c09ae8-37da-4fda-9ffc-27ad1ec0d7cf tempest-VolumeQuotasAdminTestJSON-164852418 None] Transfer volume completed successfully. Sep 25 12:45:17 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.478s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:17 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info Sep 25 12:45:17 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Flow 'volume_create_manager' (bb3c1a7d-3142-4e9c-8701-4b1c15985906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca318bc6-694e-4377-9aa2-e7f9e809e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca318bc6-694e-4377-9aa2-e7f9e809e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1940689563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a14a7ff-ed45-424b-9798-18610f30e669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0668717e067745cda4f70af9dda0685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:17Z,use_quota=True,user_id='b85f38f483cf47afad865f40097babad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a675445b-64ef-4f19-96b0-965dcf24528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a675445b-64ef-4f19-96b0-965dcf24528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d284f1b-7219-40e1-b595-2d5dda34f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d284f1b-7219-40e1-b595-2d5dda34f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a14a7ff-ed45-424b-9798-18610f30e669', 'volume_name': 'volume-2a14a7ff-ed45-424b-9798-18610f30e669', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3577b89b-4692-4c70-8554-6557da2462c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3577b89b-4692-4c70-8554-6557da2462c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef722df-fa96-4b1e-91d9-946e753d4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Volume 2a14a7ff-ed45-424b-9798-18610f30e669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a14a7ff-ed45-424b-9798-18610f30e669', 'volume_size': 1} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:17 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info" returned: 0 in 0.410s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:17 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info is being set with open permissions: ugo+rw Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Acquiring lock "cinder-ab43bd21-18ed-44eb-a15a-d7dd75531aa9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:17 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info Sep 25 12:45:17 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "cinder-ab43bd21-18ed-44eb-a15a-d7dd75531aa9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Acquiring lock "cinder-quobyte-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "cinder-quobyte-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99dcd11-00a2-4528-b72f-07aafed3bfab]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:17 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 Sep 25 12:45:17 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.info" returned: 0 in 0.316s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.996s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1940689563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a14a7ff-ed45-424b-9798-18610f30e669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0668717e067745cda4f70af9dda0685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:17Z,use_quota=True,user_id='b85f38f483cf47afad865f40097babad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Creating volume 2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:18 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:18 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 1073741824 Sep 25 12:45:18 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-35ed8d60-19ad-4478-8f7f-0834a6583e42 tempest-VolumesDeleteCascade-2134109787 None] Create snapshot completed successfully Sep 25 12:45:18 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" returned: 0 in 0.504s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:18 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9 Sep 25 12:45:18 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:18 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 1073741824" returned: 0 in 0.615s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:18 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" returned: 0 in 0.336s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "cinder-quobyte-ab43bd21-18ed-44eb-a15a-d7dd75531aa9" released by "delete_volume" :: held 0.906s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:18 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 Sep 25 12:45:18 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Created reservations ['08f550a2-fddf-4558-8fb7-678b608978e4', '0b15b78f-8e50-45a6-952e-038d089030fa', '1f073027-f51e-4342-b8b7-c779850f012f', '4f605c88-4344-4e8f-add1-0ddc91c2130c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:19 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:19 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:19 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669" returned: 0 in 0.366s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.236s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Creating offline snapshot 78f085bc-01fc-4a9c-9aef-72c63d45c339 of volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef722df-fa96-4b1e-91d9-946e753d4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a14a7ff-ed45-424b-9798-18610f30e669', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cace9e-6947-4a70-8ef9-ad7e9ce9d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d89e4a-7287-4655-82f4-5a72818dd8d2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Volume volume-2a14a7ff-ed45-424b-9798-18610f30e669 (2a14a7ff-ed45-424b-9798-18610f30e669): created successfully Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cace9e-6947-4a70-8ef9-ad7e9ce9d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Flow 'volume_create_manager' (bb3c1a7d-3142-4e9c-8701-4b1c15985906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-19149cf4-dbe8-4d1b-80b2-858b1b538227 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Created volume successfully. Sep 25 12:45:19 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.352s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Deleted volume successfully. Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-67fa48c5-edb2-422c-b1e5-b8635b58768a tempest-VolumeQuotasAdminTestJSON-1125788193 None] Lock "cinder-ab43bd21-18ed-44eb-a15a-d7dd75531aa9-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:19 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:19 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:19 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.509s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:19 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 1G Sep 25 12:45:19 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:20 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 1G" returned: 0 in 0.661s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:20 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:20 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:20 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.436s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:20 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 is being set with open permissions: ugo+rw Sep 25 12:45:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:20 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:20 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:21 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.330s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.439s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Creating offline snapshot 31f90485-a6b9-482f-a457-bea9587636a3 of volume 2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-05bc2e8a-08a7-4287-b6c5-343b0389ede0 tempest-VolumesDeleteCascade-2134109787 None] Create snapshot completed successfully Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[06924349-ae39-4d5e-86b8-b938019295aa]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:21 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 Sep 25 12:45:21 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:21 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:21 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 1G Sep 25 12:45:21 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-12bc9fe5-c627-45a5-8f2d-5a2f3982a501-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-12bc9fe5-c627-45a5-8f2d-5a2f3982a501-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Performing cascade delete. {{(pid=87094) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-37d59c04-92bf-43b4-8c9f-71c7d86e86cb-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-37d59c04-92bf-43b4-8c9f-71c7d86e86cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-37d59c04-92bf-43b4-8c9f-71c7d86e86cb" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-37d59c04-92bf-43b4-8c9f-71c7d86e86cb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Deleting offline snapshot 37d59c04-92bf-43b4-8c9f-71c7d86e86cb of volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] snapshot_file for this snap is: volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558e218-47b0-493e-9fed-1cebce83a934]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:22 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 1G" returned: 0 in 0.700s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a14a7ff-ed45-424b-9798-18610f30e669 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:22 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:22 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:22 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a14a7ff-ed45-424b-9798-18610f30e669 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 Sep 25 12:45:22 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:23 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.644s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8745a04-a5fc-46e0-8445-6ee1f3be8b67]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:23 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a14a7ff-ed45-424b-9798-18610f30e669 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:23 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 is being set with open permissions: ugo+rw Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:23 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 Sep 25 12:45:23 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:23 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:23 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:23 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3" returned: 0 in 0.388s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:23 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info Sep 25 12:45:23 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:23 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.789s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:23 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:24 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Flow 'volume_create_manager' (5ec510e5-51bc-4053-a59c-31c0f9bda76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa1e275-baf5-4f6c-9f82-6a97156744da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff69c7-5ba2-4439-a3ef-cd43461e61ff]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info" returned: 0 in 0.452s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:24 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info is being set with open permissions: ugo+rw Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:24 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa1e275-baf5-4f6c-9f82-6a97156744da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1063770277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80423126-a93d-4e76-803a-8e5c193ce393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d723d6ffc4114c3fbaad50de1d5c5aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:24Z,use_quota=True,user_id='74454ab03e194126b2754ad9ba8f7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:24 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7d5d0-5344-4f5b-a72b-644690b85a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7d5d0-5344-4f5b-a72b-644690b85a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587f9646-c514-4117-89f0-55024b2c8783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587f9646-c514-4117-89f0-55024b2c8783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80423126-a93d-4e76-803a-8e5c193ce393', 'volume_name': 'volume-80423126-a93d-4e76-803a-8e5c193ce393', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c10929b-a389-43e5-a00e-949feef97de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c10929b-a389-43e5-a00e-949feef97de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f031f6-08b4-4ae1-a9f1-8e0c86de41c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:24 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Volume 80423126-a93d-4e76-803a-8e5c193ce393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80423126-a93d-4e76-803a-8e5c193ce393', 'volume_size': 1} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:24 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:24 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:24 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.info" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1063770277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80423126-a93d-4e76-803a-8e5c193ce393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d723d6ffc4114c3fbaad50de1d5c5aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:24Z,use_quota=True,user_id='74454ab03e194126b2754ad9ba8f7a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Creating volume 80423126-a93d-4e76-803a-8e5c193ce393 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:24 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:24 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 1073741824 Sep 25 12:45:24 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e72b4832-3feb-41e4-9a54-79ec3b3c4f32 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Create snapshot completed successfully Sep 25 12:45:24 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.629s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[75306e04-c175-4bca-a864-65799cb9aeee]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:24 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:24 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:25 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 1073741824" returned: 0 in 0.639s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:25 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:25 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.569s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:25 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[01219c85-01ca-4795-83c0-4982a89c7200]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:25 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:25 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:25 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393" returned: 0 in 0.412s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f031f6-08b4-4ae1-a9f1-8e0c86de41c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80423126-a93d-4e76-803a-8e5c193ce393', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8473270-0db5-48dd-818b-af84aca31180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:25 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Volume volume-80423126-a93d-4e76-803a-8e5c193ce393 (80423126-a93d-4e76-803a-8e5c193ce393): created successfully Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8473270-0db5-48dd-818b-af84aca31180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Flow 'volume_create_manager' (5ec510e5-51bc-4053-a59c-31c0f9bda76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0d2af142-0056-4149-8a99-82789b7230ba tempest-VolumesServicesTestJSON-1796109711 None] Created volume successfully. Sep 25 12:45:25 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.574s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:25 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:25 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "cinder-31f90485-a6b9-482f-a457-bea9587636a3-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-31f90485-a6b9-482f-a457-bea9587636a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "cinder-quobyte-31f90485-a6b9-482f-a457-bea9587636a3" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-31f90485-a6b9-482f-a457-bea9587636a3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Deleting offline snapshot 31f90485-a6b9-482f-a457-bea9587636a3 of volume 2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] snapshot_file for this snap is: volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef7daf-6222-437e-b336-3cabce62cd0b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Acquiring lock "cinder-80423126-a93d-4e76-803a-8e5c193ce393-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "cinder-80423126-a93d-4e76-803a-8e5c193ce393-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Acquiring lock "cinder-quobyte-80423126-a93d-4e76-803a-8e5c193ce393" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:26 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 Sep 25 12:45:26 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "cinder-quobyte-80423126-a93d-4e76-803a-8e5c193ce393" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0aa37a-ea01-4908-bf9a-86bdced5ec92]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.638s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb Sep 25 12:45:26 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:26 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 Sep 25 12:45:26 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:26 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3" returned: 0 in 0.709s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a14a7ff-ed45-424b-9798-18610f30e669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1e20f1-41e4-4c0d-87c2-7458175a252c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.37d59c04-92bf-43b4-8c9f-71c7d86e86cb" returned: 0 in 0.427s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 -F qcow2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 -F qcow2 Sep 25 12:45:26 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:27 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 Sep 25 12:45:27 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:27 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393" returned: 0 in 0.673s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:27 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393 Sep 25 12:45:27 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:27 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 -F qcow2" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-37d59c04-92bf-43b4-8c9f-71c7d86e86cb" released by "_delete_snapshot" :: held 5.155s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:27 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669" returned: 0 in 0.625s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:27 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" released by "delete_snapshot" :: held 5.208s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-80423126-a93d-4e76-803a-8e5c193ce393" returned: 0 in 0.460s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:27 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 Sep 25 12:45:27 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "cinder-quobyte-80423126-a93d-4e76-803a-8e5c193ce393" released by "delete_volume" :: held 1.204s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['6c49ce02-752e-4c37-b266-a5d1db5d9447', '1578269c-cbd0-4d02-ab1d-69327c0fda3f', '4bacdcd8-0c32-4e37-a637-de1054d85604', '5bd6ee6e-3a55-43f1-a716-6738523d1157'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Created reservations ['d3addef0-55d1-49f2-a727-b0a195dae1c9', 'b462712f-6d1a-4889-8c9b-b28168c8acf0', '45c07d39-f3b7-408a-bef3-c99dfba35d8f', '80b20601-183e-4a5d-ac6e-61ba2005c9bf'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:27 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Delete snapshot completed successfully. Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-37d59c04-92bf-43b4-8c9f-71c7d86e86cb-delete_snapshot" released by "delete_snapshot" :: held 5.557s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-78f085bc-01fc-4a9c-9aef-72c63d45c339-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-78f085bc-01fc-4a9c-9aef-72c63d45c339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:27 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:27 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-78f085bc-01fc-4a9c-9aef-72c63d45c339" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-78f085bc-01fc-4a9c-9aef-72c63d45c339" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Deleting offline snapshot 78f085bc-01fc-4a9c-9aef-72c63d45c339 of volume 12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] snapshot_file for this snap is: volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee84ada-ca8b-45ce-a0f2-7cd1720f9497]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:28 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3" returned: 0 in 0.630s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:28 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3 Sep 25 12:45:28 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:28 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:28 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:28 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Deleted volume successfully. Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0e92914a-ccb8-437c-a47a-ca70b5a115d5 tempest-VolumesServicesTestJSON-1796109711 None] Lock "cinder-80423126-a93d-4e76-803a-8e5c193ce393-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:28 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669.31f90485-a6b9-482f-a457-bea9587636a3" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-31f90485-a6b9-482f-a457-bea9587636a3" released by "_delete_snapshot" :: held 2.580s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" released by "delete_snapshot" :: held 2.615s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:28 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.664s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Created reservations ['2849e08e-c936-4e2b-9fec-44782181263f', '02e7297d-23d4-4a9e-a383-076b498f1484', '390fab35-1d10-4c81-b061-7ffa5e6b758d', '442e2eae-9b09-4c4b-ba2d-3f26d9a59714'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9557bd-cae5-4aee-ae51-6ff5228d97e7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Delete snapshot completed successfully. Sep 25 12:45:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2779870a-bc9c-44da-9d92-7047ebe80811 tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-31f90485-a6b9-482f-a457-bea9587636a3-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:28 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:28 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:29 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.525s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "cinder-2a14a7ff-ed45-424b-9798-18610f30e669-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:29 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:29 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-2a14a7ff-ed45-424b-9798-18610f30e669-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" acquired by "delete_volume" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e89f3-466c-467b-a33d-e6300f85a83e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:29 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 Sep 25 12:45:29 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:29 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.523s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:29 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339 Sep 25 12:45:29 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:30 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669" returned: 0 in 0.653s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:30 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669 Sep 25 12:45:30 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:30 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501.78f085bc-01fc-4a9c-9aef-72c63d45c339" returned: 0 in 0.396s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-78f085bc-01fc-4a9c-9aef-72c63d45c339" released by "_delete_snapshot" :: held 2.281s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" released by "delete_snapshot" :: held 2.319s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['4bb56dee-17e9-44b8-8aca-7fa8974408e3', 'd3c4aa87-66c0-40b3-b0fa-51b3c2ab35b8', 'c79b8d67-ac46-4fe4-a541-e7eeabab5e33', 'ba7ef781-a9df-4dc3-a213-fbc2091b832d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Delete snapshot completed successfully. Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-78f085bc-01fc-4a9c-9aef-72c63d45c339-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Snapshots deleted, issuing volume delete {{(pid=87094) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" acquired by "delete_volume" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad953e0c-6dcc-4195-9373-5bf3a5429d23]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:30 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a14a7ff-ed45-424b-9798-18610f30e669" returned: 0 in 0.481s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-quobyte-2a14a7ff-ed45-424b-9798-18610f30e669" released by "delete_volume" :: held 1.249s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:30 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Created reservations ['21e50de5-38c3-4ab9-9b29-1506705a30c6', '22426bfd-ac30-4785-8e9a-0e195df03c8c', '0179068d-6a0f-453c-9297-ec3809e735ea', 'e9bb2524-c5be-4cc0-9641-35227e7be7a1'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:30 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:30 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:31 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:31 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:31 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.687s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:31 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501 Sep 25 12:45:31 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:31 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Deleted volume successfully. Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0510a825-218d-472c-b762-790093b087bd tempest-VolumeSnapshotQuotasNegativeTestJSON-86424493 None] Lock "cinder-2a14a7ff-ed45-424b-9798-18610f30e669-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:31 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" returned: 0 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-12bc9fe5-c627-45a5-8f2d-5a2f3982a501" released by "delete_volume" :: held 1.220s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['e1f85a1a-e5d1-4775-8b4c-e8717e52445b', '533947fd-7e4f-40c5-8f56-406b88a72ac9', 'b0a6800f-131d-494d-8af5-eb56b43f4c6e', '8d5ff513-8706-4ffc-81bf-47f4482031d4'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:32 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:32 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:32 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.494s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Deleted volume successfully. Sep 25 12:45:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ebfa3623-035e-4aa4-9c78-8a14f9b8e8de tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-12bc9fe5-c627-45a5-8f2d-5a2f3982a501-delete_volume" released by "delete_volume" :: held 10.426s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (38c24f46-514f-4e1c-b908-11c7c2fc6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a831c4c9-511e-4808-b4be-c059632416cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a831c4c9-511e-4808-b4be-c059632416cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-117269690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30f449d-1360-41a8-b0f5-0be5c5b2936d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300dff65aadd49d09dae2d13b34c0d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:34Z,use_quota=True,user_id='cc44964524bc4821b4b78e545c583fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3044a565-f8a3-4b3b-ada3-30fab9a4a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3044a565-f8a3-4b3b-ada3-30fab9a4a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c10f9c-c1d7-472f-9c5e-62ba45b7a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c10f9c-c1d7-472f-9c5e-62ba45b7a39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30f449d-1360-41a8-b0f5-0be5c5b2936d', 'volume_name': 'volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d689a02-263e-4312-8075-e0c1532c0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d689a02-263e-4312-8075-e0c1532c0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d9d6b6-1bba-4ac0-9c2f-85ede36720e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Volume e30f449d-1360-41a8-b0f5-0be5c5b2936d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d', 'volume_size': 1} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-117269690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30f449d-1360-41a8-b0f5-0be5c5b2936d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300dff65aadd49d09dae2d13b34c0d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:34Z,use_quota=True,user_id='cc44964524bc4821b4b78e545c583fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Creating volume e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:34 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:34 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d 1073741824 Sep 25 12:45:34 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:35 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d 1073741824" returned: 0 in 0.735s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:35 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:35 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:35 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d9d6b6-1bba-4ac0-9c2f-85ede36720e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c00ee5f-12a0-4bee-8438-ffcf1fa04e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:35 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Volume volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d (e30f449d-1360-41a8-b0f5-0be5c5b2936d): created successfully Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c00ee5f-12a0-4bee-8438-ffcf1fa04e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (38c24f46-514f-4e1c-b908-11c7c2fc6e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e18f1d8e-af44-43a6-b82c-f90deeab5488 tempest-VolumesDeleteCascade-2134109787 None] Created volume successfully. Sep 25 12:45:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Creating offline snapshot 775717ab-09dd-42e1-8214-61636f21a5be of volume e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[58715e22-61f2-4f4f-a5ac-3bcb24b9fb90]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:37 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:37 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:37 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.700s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:37 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be 1G Sep 25 12:45:37 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:38 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be 1G" returned: 0 in 0.698s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:38 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:38 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:38 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.518s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:38 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be is being set with open permissions: ugo+rw Sep 25 12:45:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:38 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:38 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:39 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info Sep 25 12:45:39 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info" returned: 0 in 0.341s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info is being set with open permissions: ugo+rw Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:39 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info Sep 25 12:45:39 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.info" returned: 0 in 0.414s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.262s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b0991b4f-4141-4878-9854-c6ac9a78fe04 tempest-VolumesDeleteCascade-2134109787 None] Create snapshot completed successfully Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (fc44292a-f3e2-4e9c-af4f-c1930e5701e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3430e1f5-1301-4d17-b319-5a0d0da6426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3430e1f5-1301-4d17-b319-5a0d0da6426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-667423722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e115449-24c8-4bcb-bb4e-f68bed371b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='300dff65aadd49d09dae2d13b34c0d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=775717ab-09dd-42e1-8214-61636f21a5be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:42Z,use_quota=True,user_id='cc44964524bc4821b4b78e545c583fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a066cffe-8a90-459f-a503-afe5c67dd316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a066cffe-8a90-459f-a503-afe5c67dd316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e11addc-a042-425c-b1f9-c98df5356502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e11addc-a042-425c-b1f9-c98df5356502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e115449-24c8-4bcb-bb4e-f68bed371b2c', 'volume_name': 'volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c', 'volume_size': 1, 'snapshot_id': '775717ab-09dd-42e1-8214-61636f21a5be'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901cacda-88da-4013-b337-b30cf7083177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901cacda-88da-4013-b337-b30cf7083177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e98e55-2fb3-4c7b-a74a-7216275abcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:41 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Volume 0e115449-24c8-4bcb-bb4e-f68bed371b2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c', 'volume_size': 1, 'snapshot_id': '775717ab-09dd-42e1-8214-61636f21a5be'} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be-0e115449-24c8-4bcb-bb4e-f68bed371b2c" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be-0e115449-24c8-4bcb-bb4e-f68bed371b2c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Creating volume 0e115449-24c8-4bcb-bb4e-f68bed371b2c from snapshot 775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] snapshot: 775717ab-09dd-42e1-8214-61636f21a5be, volume: 0e115449-24c8-4bcb-bb4e-f68bed371b2c, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53f58c-c243-4938-9e7f-2e3873232634]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:42 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:42 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:42 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.681s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[166904d5-9de8-4fa1-9d87-99ae2529251b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:43 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:43 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:43 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.640s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:45:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:45:43 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:45:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:43 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c Sep 25 12:45:43 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Flow 'volume_create_manager' (7f9094e2-3a9e-4ea8-a72d-cc83a4e5e1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab496380-f300-4bc7-84db-e84093971dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab496380-f300-4bc7-84db-e84093971dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-863153896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e5fc5d-e2de-4cf6-a61c-012f3cb5696d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc509930a7f4c4bbf4415286fcd33db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:46Z,use_quota=True,user_id='90ab6b380ec14a85b4f1723d276a3332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e85626b4-b130-408d-a1ba-121415dce08f),volume_type_id=e85626b4-b130-408d-a1ba-121415dce08f)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e632cb7-18d9-4581-a890-7508705fd1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e632cb7-18d9-4581-a890-7508705fd1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b9705-4887-4558-b685-7febcfd628e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943b9705-4887-4558-b685-7febcfd628e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e5fc5d-e2de-4cf6-a61c-012f3cb5696d', 'volume_name': 'volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9000083a-04a1-4a5b-a45b-f44b7fb6022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9000083a-04a1-4a5b-a45b-f44b7fb6022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba3932a-30d4-4e76-b3b8-610820833ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Volume 89e5fc5d-e2de-4cf6-a61c-012f3cb5696d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d', 'volume_size': 1} Sep 25 12:45:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:47 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:47 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:48 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.952s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:48 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:45:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:45:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:45:52 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c" returned: 0 in 9.269s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:52 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d, size 1024.00 MB, duration 9.27 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:45:52 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Converted 1024.00 MB image at 110.45 MB/s Sep 25 12:45:52 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c is being set with open permissions: ugo+rw Sep 25 12:45:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:52 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c Sep 25 12:45:52 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:52 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c" returned: 0 in 0.322s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" released by "_copy_volume_from_snapshot" :: held 11.048s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be-0e115449-24c8-4bcb-bb4e-f68bed371b2c" released by "_create_volume_from_snapshot" :: held 11.148s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.171s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.143s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-863153896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e5fc5d-e2de-4cf6-a61c-012f3cb5696d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc509930a7f4c4bbf4415286fcd33db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:46Z,use_quota=True,user_id='90ab6b380ec14a85b4f1723d276a3332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e85626b4-b130-408d-a1ba-121415dce08f),volume_type_id=e85626b4-b130-408d-a1ba-121415dce08f)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Creating volume 89e5fc5d-e2de-4cf6-a61c-012f3cb5696d {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:53 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:53 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d 1073741824 Sep 25 12:45:53 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e98e55-2fb3-4c7b-a74a-7216275abcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c', 'volume_size': 1, 'snapshot_id': '775717ab-09dd-42e1-8214-61636f21a5be'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72fd797-6fd2-40e6-9b60-0ed772e652a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Volume volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c (0e115449-24c8-4bcb-bb4e-f68bed371b2c): created successfully Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72fd797-6fd2-40e6-9b60-0ed772e652a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Flow 'volume_create_manager' (fc44292a-f3e2-4e9c-af4f-c1930e5701e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-eb6c1d2a-c223-40da-93c6-0fde2550ac56 tempest-VolumesDeleteCascade-2134109787 None] Created volume successfully. Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-e30f449d-1360-41a8-b0f5-0be5c5b2936d-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-e30f449d-1360-41a8-b0f5-0be5c5b2936d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Performing cascade delete. {{(pid=87094) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-775717ab-09dd-42e1-8214-61636f21a5be-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-775717ab-09dd-42e1-8214-61636f21a5be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:53 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d 1073741824" returned: 0 in 0.830s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Deleting offline snapshot 775717ab-09dd-42e1-8214-61636f21a5be of volume e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] snapshot_file for this snap is: volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7757ab-8398-4d64-98e8-15751748e982]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:54 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d Sep 25 12:45:54 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:54 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:54 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:54 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" returned: 0 in 0.461s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba3932a-30d4-4e76-b3b8-610820833ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:54 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7035fa1e-3d62-4881-8d8f-2de4b43cd848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.534s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:54 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Volume volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d (89e5fc5d-e2de-4cf6-a61c-012f3cb5696d): created successfully Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7035fa1e-3d62-4881-8d8f-2de4b43cd848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Flow 'volume_create_manager' (7f9094e2-3a9e-4ea8-a72d-cc83a4e5e1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb4f49-f7d8-457b-b026-ced68428f3ed]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5e044ea6-36d6-4d63-aedf-3fa700723fff tempest-VolumeTypesAccessTest-1624019723 None] Created volume successfully. Sep 25 12:45:54 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:54 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Acquiring lock "cinder-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "cinder-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Acquiring lock "cinder-quobyte-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "cinder-quobyte-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e9361-620e-4c0e-97ce-49e3c67fa640]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:55 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d Sep 25 12:45:55 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:55 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.823s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:55 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:55 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:55 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" returned: 0 in 0.611s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:55 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d Sep 25 12:45:55 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:56 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.698s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:56 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be Sep 25 12:45:56 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:56 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" returned: 0 in 0.521s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "cinder-quobyte-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d" released by "delete_volume" :: held 1.220s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:56 devstack cinder-volume[87094]: WARNING cinder.quota [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1298876709 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1298876709, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:56 devstack cinder-volume[87094]: WARNING cinder.quota [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1298876709 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1298876709, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Created reservations ['c71de397-b8e5-49fa-9123-7bebaa6f196e', '41580b0f-3a8d-479d-a665-97d3f63adaa0', '028d3f50-bbb9-4c93-bad5-77603ffedc48', '58c9aa2e-6f32-41f7-88c7-bf185a6afb6d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:56 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:56 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:56 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d.775717ab-09dd-42e1-8214-61636f21a5be" returned: 0 in 0.517s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-775717ab-09dd-42e1-8214-61636f21a5be" released by "_delete_snapshot" :: held 2.771s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" released by "delete_snapshot" :: held 2.819s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['cce5f3f2-427a-4420-9c75-040014b8f038', '7f4d9e4a-6440-452e-b030-baff883f4662', 'ae8944d1-0910-4cb0-85ea-387a83a15eaa', '67549b27-6821-4749-ae34-33c3eeb5553b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Delete snapshot completed successfully. Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-775717ab-09dd-42e1-8214-61636f21a5be-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Snapshots deleted, issuing volume delete {{(pid=87094) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:57 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.542s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Deleted volume successfully. Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca18ed-9003-4c28-a359-3a95fdf1ff73]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7be6aaf9-fcbd-45b4-82ca-0179840345c5 tempest-VolumeTypesAccessTest-1624019723 None] Lock "cinder-89e5fc5d-e2de-4cf6-a61c-012f3cb5696d-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:57 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:57 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:57 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.618s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:57 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d Sep 25 12:45:57 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:58 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e30f449d-1360-41a8-b0f5-0be5c5b2936d" returned: 0 in 0.448s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-e30f449d-1360-41a8-b0f5-0be5c5b2936d" released by "delete_volume" :: held 1.203s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['c5b09fde-6440-4ddc-825d-36ca3aabc5fa', '5be18b8f-6124-45fd-9eaf-16913f9a6595', 'c93e9933-596d-48f2-bdef-31771414eb4f', 'd1619f78-f374-46d9-83e8-785457241bcc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:58 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:45:58 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:59 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.531s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Deleted volume successfully. Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47e0fe6d-4ce5-4fee-8cdf-2028a7bff62e tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-e30f449d-1360-41a8-b0f5-0be5c5b2936d-delete_volume" released by "delete_volume" :: held 5.405s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-0e115449-24c8-4bcb-bb4e-f68bed371b2c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-0e115449-24c8-4bcb-bb4e-f68bed371b2c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[48221019-6569-4789-a862-529192b1e6f1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:00 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c Sep 25 12:46:00 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:00 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c" returned: 0 in 0.784s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:00 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c Sep 25 12:46:00 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:01 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0e115449-24c8-4bcb-bb4e-f68bed371b2c" returned: 0 in 0.462s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-quobyte-0e115449-24c8-4bcb-bb4e-f68bed371b2c" released by "delete_volume" :: held 1.347s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Created reservations ['08002145-313e-44fc-8e34-0ee3100f916e', '23822d16-3adc-42eb-b5dd-d38d562d58fc', '66153815-f993-4154-b3bf-acc959a3572f', '0f3f3ade-8b91-4adb-b76d-d7a86a3aa804'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:01 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:01 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:01 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.415s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:01 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Deleted volume successfully. Sep 25 12:46:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9e201f4f-cd5f-410c-b198-ec509d5cc6b9 tempest-VolumesDeleteCascade-2134109787 None] Lock "cinder-0e115449-24c8-4bcb-bb4e-f68bed371b2c-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=111,cinder:UPDATE=141,cinder:INSERT=29,cinder:DELETE=17 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=113,cinder:UPDATE=138,cinder:INSERT=39,cinder:DELETE=4 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Flow 'volume_create_manager' (dec4c742-4cb7-4a64-8921-cfe05c74be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8d8d1-33bd-4fca-b793-cda6a535b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8d8d1-33bd-4fca-b793-cda6a535b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-808262809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04f8619-cb45-4393-925b-fa4890fd5fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669cc51ea8564bfd85a4a287e76e028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:05Z,use_quota=True,user_id='cfaf7c87f2ab42fdaba01e3ce84b8531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7026a3-1ed3-41fb-b804-d91fb18eef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7026a3-1ed3-41fb-b804-d91fb18eef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f25543-348c-4913-aa78-35231842363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f25543-348c-4913-aa78-35231842363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04f8619-cb45-4393-925b-fa4890fd5fd1', 'volume_name': 'volume-f04f8619-cb45-4393-925b-fa4890fd5fd1', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe31bad-aa30-48f3-a638-9ccf9e5fecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe31bad-aa30-48f3-a638-9ccf9e5fecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b3e6f9-9dfc-4f3a-a760-ed5581657db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Volume f04f8619-cb45-4393-925b-fa4890fd5fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04f8619-cb45-4393-925b-fa4890fd5fd1', 'volume_size': 1} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-808262809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04f8619-cb45-4393-925b-fa4890fd5fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669cc51ea8564bfd85a4a287e76e028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:05Z,use_quota=True,user_id='cfaf7c87f2ab42fdaba01e3ce84b8531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Creating volume f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:05 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:05 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 1073741824 Sep 25 12:46:05 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:05 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 1073741824" returned: 0 in 0.710s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:06 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 Sep 25 12:46:06 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:06 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1" returned: 0 in 0.406s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b3e6f9-9dfc-4f3a-a760-ed5581657db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04f8619-cb45-4393-925b-fa4890fd5fd1', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02499c1b-8003-4b72-981e-104393209e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Volume volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 (f04f8619-cb45-4393-925b-fa4890fd5fd1): created successfully Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02499c1b-8003-4b72-981e-104393209e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Flow 'volume_create_manager' (dec4c742-4cb7-4a64-8921-cfe05c74be86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:06 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-49e7d6a3-ee6e-4a8c-bb29-08ec1cb6064e tempest-SnapshotMetadataTestJSON-1524047113 None] Created volume successfully. Sep 25 12:46:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Creating offline snapshot a7cca434-01a7-4e8f-bae2-381a4d74616a of volume f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:46:07 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5eb57-ad1f-4e9f-bd69-d5bea6a80516]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:07 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 Sep 25 12:46:07 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:08 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1" returned: 0 in 0.549s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:08 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a 1G Sep 25 12:46:08 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:09 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a 1G" returned: 0 in 0.775s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:09 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a Sep 25 12:46:09 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:09 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:09 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a is being set with open permissions: ugo+rw Sep 25 12:46:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:09 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a Sep 25 12:46:09 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:10 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a" returned: 0 in 0.443s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:10 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info Sep 25 12:46:10 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:10 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info" returned: 0 in 0.560s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:10 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info is being set with open permissions: ugo+rw Sep 25 12:46:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:10 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info Sep 25 12:46:10 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:11 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.info" returned: 0 in 0.522s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.548s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-84a36f2b-4251-4aa1-ba52-eacc031cda84 tempest-SnapshotMetadataTestJSON-1524047113 None] Create snapshot completed successfully Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Flow 'volume_create_manager' (21ac28cd-0803-477a-9882-132492955bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0515b740-b48e-4b81-8853-6dc62ded2472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0515b740-b48e-4b81-8853-6dc62ded2472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1522096778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0c8804-668d-4dea-903d-b372fafaa094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f254226fdd443008a5343324e36d892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:13Z,use_quota=True,user_id='c284a4c2fbd64ff29e503219e3d6cce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3516e57-33fc-43dc-bd77-c9cf292f82af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3516e57-33fc-43dc-bd77-c9cf292f82af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddd8695-79a4-4904-b85b-b90b5443f7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddd8695-79a4-4904-b85b-b90b5443f7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0c8804-668d-4dea-903d-b372fafaa094', 'volume_name': 'volume-be0c8804-668d-4dea-903d-b372fafaa094', 'volume_size': 2}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835ac098-0fad-4822-86b5-b4cca117fdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835ac098-0fad-4822-86b5-b4cca117fdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1608918c-06bd-4c16-920f-b33b584ef001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Volume be0c8804-668d-4dea-903d-b372fafaa094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0c8804-668d-4dea-903d-b372fafaa094', 'volume_size': 2} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1522096778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0c8804-668d-4dea-903d-b372fafaa094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f254226fdd443008a5343324e36d892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:13Z,use_quota=True,user_id='c284a4c2fbd64ff29e503219e3d6cce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Creating volume be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:12 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 2147483648 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:12 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 2147483648 Sep 25 12:46:12 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:13 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 2147483648" returned: 0 in 0.933s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:13 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 Sep 25 12:46:13 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "cinder-a7cca434-01a7-4e8f-bae2-381a4d74616a-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-a7cca434-01a7-4e8f-bae2-381a4d74616a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "cinder-quobyte-a7cca434-01a7-4e8f-bae2-381a4d74616a" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-a7cca434-01a7-4e8f-bae2-381a4d74616a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Deleting offline snapshot a7cca434-01a7-4e8f-bae2-381a4d74616a of volume f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:46:14 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] snapshot_file for this snap is: volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094" returned: 0 in 0.406s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1608918c-06bd-4c16-920f-b33b584ef001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0c8804-668d-4dea-903d-b372fafaa094', 'volume_size': 2}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b577d0a-cdd6-4058-a4b3-c5314c032f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c9349-9175-4415-8dba-4556c663f9ea]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Volume volume-be0c8804-668d-4dea-903d-b372fafaa094 (be0c8804-668d-4dea-903d-b372fafaa094): created successfully Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b577d0a-cdd6-4058-a4b3-c5314c032f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Flow 'volume_create_manager' (21ac28cd-0803-477a-9882-132492955bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-65c02d79-b026-4173-b761-a0329c225819 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Created volume successfully. Sep 25 12:46:14 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a Sep 25 12:46:14 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:14 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a" returned: 0 in 0.735s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f04f8619-cb45-4393-925b-fa4890fd5fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (fde8780f-3430-46af-a659-c1f37fbdb87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823efb1a-871c-4d9e-b361-f022fc5ef14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[060e1f02-8357-4a99-9d31-774589c96642]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823efb1a-871c-4d9e-b361-f022fc5ef14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-962848438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f3d3e1-a867-4283-b5ec-98eb1ebca10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:15Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597e91c6-c051-4e83-96db-f79901888acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597e91c6-c051-4e83-96db-f79901888acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1388f5ab-1e56-482b-9718-15f7970fee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1388f5ab-1e56-482b-9718-15f7970fee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f3d3e1-a867-4283-b5ec-98eb1ebca10b', 'volume_name': 'volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050986cc-e6fd-49e1-a336-4d5a57e9aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050986cc-e6fd-49e1-a336-4d5a57e9aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12461e7-0577-4878-aff2-14085661d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Volume 25f3d3e1-a867-4283-b5ec-98eb1ebca10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b', 'volume_size': 1} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-962848438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f3d3e1-a867-4283-b5ec-98eb1ebca10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:15Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Creating volume 25f3d3e1-a867-4283-b5ec-98eb1ebca10b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:15 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 Sep 25 12:46:15 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:15 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b 1073741824 Sep 25 12:46:15 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:15 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1" returned: 0 in 0.460s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:15 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a Sep 25 12:46:15 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:15 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b 1073741824" returned: 0 in 0.630s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:15 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b Sep 25 12:46:15 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:16 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a" returned: 0 in 0.502s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:16 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a Sep 25 12:46:16 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:16 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12461e7-0577-4878-aff2-14085661d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a164501-0590-4a79-8eef-94574dafe7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Creating offline snapshot 623f80dc-aad8-4148-8c83-f95816714630 of volume be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:46:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Volume volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b (25f3d3e1-a867-4283-b5ec-98eb1ebca10b): created successfully Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a164501-0590-4a79-8eef-94574dafe7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (fde8780f-3430-46af-a659-c1f37fbdb87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57c3e6-3c76-4505-8cc6-193c78e9affb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cae39bd6-5537-4b79-9444-4b5ed12a18b6 tempest-VolumesListAdminTestJSON-493275286 None] Created volume successfully. Sep 25 12:46:16 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1.a7cca434-01a7-4e8f-bae2-381a4d74616a" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:16 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 Sep 25 12:46:16 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-a7cca434-01a7-4e8f-bae2-381a4d74616a" released by "_delete_snapshot" :: held 2.444s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" released by "delete_snapshot" :: held 2.481s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:16 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Created reservations ['9ce747f6-2817-47fb-8128-eb3686cb5821', '542d9ad1-4b15-414b-942e-47890d99880b', '7e03fbac-4586-4d41-ab33-4c0696685a28', 'abfd5891-cdf6-4b83-a598-f7e07063110e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Delete snapshot completed successfully. Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-97ec0cce-4b74-42c2-904d-de0e105156c5 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-a7cca434-01a7-4e8f-bae2-381a4d74616a-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:17 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094" returned: 0 in 0.845s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 2G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:17 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 2G Sep 25 12:46:17 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "cinder-f04f8619-cb45-4393-925b-fa4890fd5fd1-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-f04f8619-cb45-4393-925b-fa4890fd5fd1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af09f51-18ec-45bf-bcc3-5b6ebd48ebe1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:17 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 Sep 25 12:46:17 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (b5d28862-40bf-4132-9380-43fc8df8c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b229fd-27e0-4958-a60a-cd18ff50ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b229fd-27e0-4958-a60a-cd18ff50ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233188628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d062d4-5178-4d1d-9891-2bb7f327e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:18Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24a0f21-9ff7-4a38-9fb3-2a18a086d39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24a0f21-9ff7-4a38-9fb3-2a18a086d39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:18 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a36a48-d393-4318-a658-08e8381bb171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a36a48-d393-4318-a658-08e8381bb171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d062d4-5178-4d1d-9891-2bb7f327e2cd', 'volume_name': 'volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a462bed-2608-4473-80fc-73e947900e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a462bed-2608-4473-80fc-73e947900e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5dfde8-fad4-4b61-bf6c-6b8fc8e584b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Volume f9d062d4-5178-4d1d-9891-2bb7f327e2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd', 'volume_size': 1} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 2G" returned: 0 in 0.908s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0c8804-668d-4dea-903d-b372fafaa094 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:18 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0c8804-668d-4dea-903d-b372fafaa094 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 Sep 25 12:46:18 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:18 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1" returned: 0 in 0.643s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:18 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1 Sep 25 12:46:18 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:18 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0c8804-668d-4dea-903d-b372fafaa094 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630" returned: 0 in 0.424s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:18 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 is being set with open permissions: ugo+rw Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:18 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 Sep 25 12:46:18 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:18 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f04f8619-cb45-4393-925b-fa4890fd5fd1" returned: 0 in 0.479s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:18 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-quobyte-f04f8619-cb45-4393-925b-fa4890fd5fd1" released by "delete_volume" :: held 1.250s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630" returned: 0 in 0.415s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:19 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info Sep 25 12:46:19 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Created reservations ['5bdf6625-1e3d-41e7-a890-ab3ae162c954', '35165f67-6977-4278-9c7f-0ad4cda590f5', 'cc0c3b16-55af-407a-b432-60f172edaf7e', '1673dcc4-a987-4876-b8ba-4b28a2e3189e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:19 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:19 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:19 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:19 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info is being set with open permissions: ugo+rw Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:19 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info Sep 25 12:46:19 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:19 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.348s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Deleted volume successfully. Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-df4a1e32-5e15-4ef0-a135-0b36b1a0f082 tempest-SnapshotMetadataTestJSON-1524047113 None] Lock "cinder-f04f8619-cb45-4393-925b-fa4890fd5fd1-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:19 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.info" returned: 0 in 0.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.667s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233188628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d062d4-5178-4d1d-9891-2bb7f327e2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:18Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Creating volume f9d062d4-5178-4d1d-9891-2bb7f327e2cd {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:19 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:20 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd 1073741824 Sep 25 12:46:20 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-43860325-ac78-44c7-b93a-dcf62558895b tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Create snapshot completed successfully Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "cinder-623f80dc-aad8-4148-8c83-f95816714630-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-623f80dc-aad8-4148-8c83-f95816714630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "cinder-quobyte-623f80dc-aad8-4148-8c83-f95816714630" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:20 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd 1073741824" returned: 0 in 0.823s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-623f80dc-aad8-4148-8c83-f95816714630" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Deleting offline snapshot 623f80dc-aad8-4148-8c83-f95816714630 of volume be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] snapshot_file for this snap is: volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5a409-dccd-4d9f-820f-8d0684794d9c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:20 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd Sep 25 12:46:20 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:21 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 Sep 25 12:46:21 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:21 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5dfde8-fad4-4b61-bf6c-6b8fc8e584b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a01588-9e82-427b-9aee-abc98dc347b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Volume volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd (f9d062d4-5178-4d1d-9891-2bb7f327e2cd): created successfully Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a01588-9e82-427b-9aee-abc98dc347b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (b5d28862-40bf-4132-9380-43fc8df8c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0dd40d26-f6b4-4d4f-bdba-a1574aef8f40 tempest-VolumesListAdminTestJSON-493275286 None] Created volume successfully. Sep 25 12:46:21 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630" returned: 0 in 0.684s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0c8804-668d-4dea-903d-b372fafaa094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b888e-eca9-4ca0-8e3c-c25e5eef94c0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:21 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 Sep 25 12:46:21 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:22 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094" returned: 0 in 0.598s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:22 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 Sep 25 12:46:22 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:22 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630" returned: 0 in 0.617s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:22 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630 Sep 25 12:46:22 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (db702edf-6d85-4a04-875a-45ab8ac1f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bf80e1-b95f-42d6-8aae-60791821958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bf80e1-b95f-42d6-8aae-60791821958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044753988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:23Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b084e5-52a7-4501-bbd7-2c9c1cea697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:23 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b084e5-52a7-4501-bbd7-2c9c1cea697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c283b9bd-507e-44d8-ae67-28d80bce6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c283b9bd-507e-44d8-ae67-28d80bce6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8', 'volume_name': 'volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b32e9f-8511-4a21-af5e-f43d8d836de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b32e9f-8511-4a21-af5e-f43d8d836de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71ec6b9-c4dd-4dcb-a427-ec7c5dfc595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:23 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Volume 1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8', 'volume_size': 1} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1044753988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc687d3b77c744ad95e8425e09292762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:23Z,use_quota=True,user_id='a506ef17348a4f5da73efa78062bf334',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Creating volume 1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:23 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094.623f80dc-aad8-4148-8c83-f95816714630" returned: 0 in 0.587s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:23 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 1073741824 Sep 25 12:46:23 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-623f80dc-aad8-4148-8c83-f95816714630" released by "_delete_snapshot" :: held 2.692s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" released by "delete_snapshot" :: held 2.732s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Created reservations ['f82c698f-6bee-45f7-bbda-271347364b42', 'b04e2f89-b9b7-48ed-8e96-0edb6d2ae814', '2e23188f-3ab3-4d5f-8045-45cbfaa5438e', '8e26f140-17cd-4fb3-b963-52e09cd9f6ed'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Delete snapshot completed successfully. Sep 25 12:46:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-da4e954d-2a47-4691-9dee-3ce16f9ca658 tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-623f80dc-aad8-4148-8c83-f95816714630-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "cinder-be0c8804-668d-4dea-903d-b372fafaa094-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-be0c8804-668d-4dea-903d-b372fafaa094-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:24 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 1073741824" returned: 0 in 1.044s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b112ba-2c83-4f18-b7c0-74c7d301d74f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:24 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 Sep 25 12:46:24 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:24 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 Sep 25 12:46:24 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:25 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" returned: 0 in 0.646s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71ec6b9-c4dd-4dcb-a427-ec7c5dfc595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c9e8c7-5780-4398-8c69-eb4e9f005348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094" returned: 0 in 0.739s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:25 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Volume volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 (1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8): created successfully Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c9e8c7-5780-4398-8c69-eb4e9f005348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Flow 'volume_create_manager' (db702edf-6d85-4a04-875a-45ab8ac1f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:25 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094 Sep 25 12:46:25 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-581fcce4-ec7a-46e2-b47f-45f57be8b31f tempest-VolumesListAdminTestJSON-493275286 None] Created volume successfully. Sep 25 12:46:25 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-be0c8804-668d-4dea-903d-b372fafaa094" returned: 0 in 0.484s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-quobyte-be0c8804-668d-4dea-903d-b372fafaa094" released by "delete_volume" :: held 1.340s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Created reservations ['d5aaf99b-0dfe-4647-aa80-13b72856ce69', '062096a9-9abb-4fc9-81f2-187b7e853923', '151691c9-3bb0-463d-b064-1867f2edb6f4', '8107f0da-d81a-4d55-bf0f-0562ecb6f009'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:25 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:25 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:26 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Deleted volume successfully. Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89f4c1cf-781a-46b9-b765-a78b87beab0a tempest-VolumesSnapshotNegativeTestJSON-1675316615 None] Lock "cinder-be0c8804-668d-4dea-903d-b372fafaa094-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Flow 'volume_create_manager' (923680e3-277b-4b75-8c47-67f9eda8eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec37952-d677-4d8c-9d64-91c4c81a8342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec37952-d677-4d8c-9d64-91c4c81a8342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54ed41c015435ba80de1bdf68d9761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:27Z,use_quota=True,user_id='ba9362437738497ca33313ec93b9cb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8d6272-37e4-4c4b-82af-aeba5ecbb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8d6272-37e4-4c4b-82af-aeba5ecbb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3a57ac-44ec-4785-9730-27a1b2be5235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3a57ac-44ec-4785-9730-27a1b2be5235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c', 'volume_name': 'volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84a03b6-bb81-4e24-9627-61fdffbb5c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84a03b6-bb81-4e24-9627-61fdffbb5c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e211e959-2c7f-4a48-ac01-1da1f43f626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:27 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Volume 2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c', 'volume_size': 1} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac54ed41c015435ba80de1bdf68d9761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:27Z,use_quota=True,user_id='ba9362437738497ca33313ec93b9cb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Creating volume 2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:27 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:27 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c 1073741824 Sep 25 12:46:27 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:27 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c 1073741824" returned: 0 in 0.731s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:27 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c Sep 25 12:46:27 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:28 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e211e959-2c7f-4a48-ac01-1da1f43f626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecafe610-361b-4faa-b22d-d1b6e31992cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Volume volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c (2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c): created successfully Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecafe610-361b-4faa-b22d-d1b6e31992cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Flow 'volume_create_manager' (923680e3-277b-4b75-8c47-67f9eda8eb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e3683385-7e6e-47c3-807b-faacdaea29d6 tempest-VolumesListAdminTestJSON-1291191290 None] Created volume successfully. Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Acquiring lock "cinder-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "cinder-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Acquiring lock "cinder-quobyte-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "cinder-quobyte-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" acquired by "delete_volume" :: waited 0.054s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7ee8e5-0a0e-43d5-9719-450974797a8b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-quobyte-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605de4c-5026-49a4-9a53-51a7af3fa7d3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:29 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c Sep 25 12:46:29 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:30 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 Sep 25 12:46:30 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:30 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" returned: 0 in 0.874s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:30 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:30 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" returned: 0 in 0.694s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:30 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:30 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8 Sep 25 12:46:30 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:30 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "cinder-quobyte-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c" released by "delete_volume" :: held 1.435s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Created reservations ['e014aa22-925d-4db5-9285-f47057f1908f', 'd30debe4-7ccb-48fc-b3b5-6c2a6e90aeb1', '74d08792-eada-45b3-abbd-7629b02dbb4f', 'edd32534-1028-4d9b-8546-374427a7e19a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:31 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" returned: 0 in 0.592s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8" released by "delete_volume" :: held 1.355s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Created reservations ['1753aa4c-f52f-4021-8279-1e3e55e4ed81', '31ba4569-de09-4280-ba62-a590d7f17bc9', '9192e681-726e-420a-8fcc-f2a2c794e462', '9e11c302-07d9-4f41-a66f-ef4883604a9b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:31 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:31 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:31 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:31 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:31 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Deleted volume successfully. Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05a94caa-2707-4378-a0d9-2bcdcaeefda2 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-1ec42d80-3e7e-4a88-9b44-fadc6b8cf4c8-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:31 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.626s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Deleted volume successfully. Sep 25 12:46:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-adb360ee-df23-44ea-ae33-b865b5828910 tempest-VolumesListAdminTestJSON-1291191290 None] Lock "cinder-2a16ad3f-cbd6-4ff4-96b4-0fc21f90735c-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-f9d062d4-5178-4d1d-9891-2bb7f327e2cd-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-f9d062d4-5178-4d1d-9891-2bb7f327e2cd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-quobyte-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c616063c-0327-4085-8923-3751faa399a4]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:32 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd Sep 25 12:46:32 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:33 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" returned: 0 in 0.665s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:33 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd Sep 25 12:46:33 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:33 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" returned: 0 in 0.436s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-f9d062d4-5178-4d1d-9891-2bb7f327e2cd" released by "delete_volume" :: held 1.188s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Created reservations ['759f0a5b-1472-40b0-bbf6-c37c8c27170b', '8ba48855-b7b3-4bca-99ca-a7baea6912e0', 'd6f2a320-857c-41ed-b2e7-b81da21378b8', '830f259f-f1c5-4d2a-9439-d7a949ac9b55'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:33 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:33 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:34 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:34 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Deleted volume successfully. Sep 25 12:46:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58ceea9b-8ff1-454d-9b4f-4655be6df5ec tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-f9d062d4-5178-4d1d-9891-2bb7f327e2cd-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-25f3d3e1-a867-4283-b5ec-98eb1ebca10b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-25f3d3e1-a867-4283-b5ec-98eb1ebca10b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "cinder-quobyte-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b809d-d65d-4af2-957b-fb499f2bb2cb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:35 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b Sep 25 12:46:35 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:35 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" returned: 0 in 0.723s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:35 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b Sep 25 12:46:35 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:36 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" returned: 0 in 0.514s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-quobyte-25f3d3e1-a867-4283-b5ec-98eb1ebca10b" released by "delete_volume" :: held 1.318s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Created reservations ['d902f4af-bfdb-494e-a9fe-e11dcc37e3b5', '5eeed01c-6cde-4cf2-8e5c-4706842cc4d5', '76bc1aa0-c625-4caa-b853-140b6eda0ad6', '50695115-e57b-4ae8-87f4-0f5235680a9c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:36 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:36 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:37 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Flow 'volume_create_manager' (2fb6e7b1-e265-4557-835e-959d3d812b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885262b-c89d-423f-b9d1-dad990a73fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.806s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Deleted volume successfully. Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885262b-c89d-423f-b9d1-dad990a73fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149540479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e3b3a8-e652-4834-b700-9a9d0c3d6965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b4e2f76514b83a0fab90b5893dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:37Z,use_quota=True,user_id='3e0d2688264c4228a2638eb5e4448df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff06963-aa08-4681-abc5-70f1bcd228f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff06963-aa08-4681-abc5-70f1bcd228f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3d9313-810d-4b62-a1dd-b46fadaaed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3d9313-810d-4b62-a1dd-b46fadaaed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e3b3a8-e652-4834-b700-9a9d0c3d6965', 'volume_name': 'volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a3ff1-bcfc-4b98-a97c-4feda5c4d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2a3ff1-bcfc-4b98-a97c-4feda5c4d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7569282-653c-46a8-83f2-95403d10914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Volume 55e3b3a8-e652-4834-b700-9a9d0c3d6965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965', 'volume_size': 1} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149540479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e3b3a8-e652-4834-b700-9a9d0c3d6965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b4e2f76514b83a0fab90b5893dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:37Z,use_quota=True,user_id='3e0d2688264c4228a2638eb5e4448df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Creating volume 55e3b3a8-e652-4834-b700-9a9d0c3d6965 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:37 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 1073741824 Sep 25 12:46:37 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-966c1959-db7b-4026-ae5e-9da8d2d783e5 tempest-VolumesListAdminTestJSON-493275286 None] Lock "cinder-25f3d3e1-a867-4283-b5ec-98eb1ebca10b-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:38 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 1073741824" returned: 0 in 1.053s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:39 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 Sep 25 12:46:39 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:39 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965" returned: 0 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7569282-653c-46a8-83f2-95403d10914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92604f8-22ce-428c-9996-3a03e9371047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Volume volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 (55e3b3a8-e652-4834-b700-9a9d0c3d6965): created successfully Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92604f8-22ce-428c-9996-3a03e9371047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Flow 'volume_create_manager' (2fb6e7b1-e265-4557-835e-959d3d812b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a433ea0f-02bc-4d5a-885f-f9d719cb3a7c tempest-VolumesTransfersTest-126478208 None] Created volume successfully. Sep 25 12:46:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-98b5fd8b-782a-47a5-b22a-84cdcc739c8e tempest-VolumesTransfersTest-827991764 None] Transfer volume completed successfully. Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "cinder-55e3b3a8-e652-4834-b700-9a9d0c3d6965-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-55e3b3a8-e652-4834-b700-9a9d0c3d6965-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "cinder-quobyte-55e3b3a8-e652-4834-b700-9a9d0c3d6965" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-quobyte-55e3b3a8-e652-4834-b700-9a9d0c3d6965" acquired by "delete_volume" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c2e39-ce94-4240-aa6e-c7654f20ed53]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:44 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 Sep 25 12:46:44 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:45 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965" returned: 0 in 0.912s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:45 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965 Sep 25 12:46:45 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:45 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-55e3b3a8-e652-4834-b700-9a9d0c3d6965" returned: 0 in 0.635s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-quobyte-55e3b3a8-e652-4834-b700-9a9d0c3d6965" released by "delete_volume" :: held 1.725s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Created reservations ['aab74010-9f2d-41f0-ba5a-f44f3a7d7ab3', 'c293cbb5-6d64-4b39-9274-dd75740bcfe5', '55d347db-3b7e-4549-97c0-014bdcd568cf', 'ebe7eb25-d962-4872-9280-094c2af8df84'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:46 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:46 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (9dad5e51-c5bd-4348-a46c-93f0f6bd0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b200dec5-4912-499a-951f-afab21de5590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b200dec5-4912-499a-951f-afab21de5590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-240414740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ef3281-6227-4674-8cc0-0b30a1e406c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:47Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73b28f5-b9b2-4d2e-bc0b-186300090764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73b28f5-b9b2-4d2e-bc0b-186300090764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345a8153-31a7-4479-b433-804d7bf34af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345a8153-31a7-4479-b433-804d7bf34af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ef3281-6227-4674-8cc0-0b30a1e406c2', 'volume_name': 'volume-57ef3281-6227-4674-8cc0-0b30a1e406c2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c783b37-df84-42ca-98cc-b0153bbdbbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c783b37-df84-42ca-98cc-b0153bbdbbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719c1c52-4a61-46e3-b403-de15e0ff74c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:47 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Volume 57ef3281-6227-4674-8cc0-0b30a1e406c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ef3281-6227-4674-8cc0-0b30a1e406c2', 'volume_size': 1} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-240414740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ef3281-6227-4674-8cc0-0b30a1e406c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:47Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Creating volume 57ef3281-6227-4674-8cc0-0b30a1e406c2 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:47 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:47 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:47 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 1073741824 Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:47 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.824s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Deleted volume successfully. Sep 25 12:46:47 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:47 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f9f302ab-bfad-4f28-9952-5e901ce77fe0 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-55e3b3a8-e652-4834-b700-9a9d0c3d6965-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:47 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.549s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:46:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:48 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Flow 'volume_create_manager' (c8e844dc-9b43-4885-bd40-8e788f4bd51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6eac14-01f7-433c-bffe-792ef6948af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 1073741824" returned: 0 in 1.235s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6eac14-01f7-433c-bffe-792ef6948af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1544917718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b4e2f76514b83a0fab90b5893dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:48Z,use_quota=True,user_id='3e0d2688264c4228a2638eb5e4448df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb6fa91-4f15-40c0-8a83-0bed6388e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb6fa91-4f15-40c0-8a83-0bed6388e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f166d731-a5ef-4839-b3f0-509914b123cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f166d731-a5ef-4839-b3f0-509914b123cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e', 'volume_name': 'volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a89d6c7-5edd-440d-a9a3-a0149a215ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a89d6c7-5edd-440d-a9a3-a0149a215ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63dd6b54-cb7f-4438-8af0-c2d531d6f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:48 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Volume 0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e', 'volume_size': 1} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:48 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 Sep 25 12:46:48 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:49 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2" returned: 0 in 0.629s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1544917718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391b4e2f76514b83a0fab90b5893dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:48Z,use_quota=True,user_id='3e0d2688264c4228a2638eb5e4448df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Creating volume 0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:49 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:49 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e 1073741824 Sep 25 12:46:49 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719c1c52-4a61-46e3-b403-de15e0ff74c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ef3281-6227-4674-8cc0-0b30a1e406c2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9aa40-1ff3-4d36-a15f-67ec1dc89a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Volume volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 (57ef3281-6227-4674-8cc0-0b30a1e406c2): created successfully Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9aa40-1ff3-4d36-a15f-67ec1dc89a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (9dad5e51-c5bd-4348-a46c-93f0f6bd0e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0e7d84a9-28d1-4c0d-b118-ba553dc91e6b tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:46:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bd0207b1-9a63-4e32-9ec1-779e2579ff98 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2" by "attach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bd0207b1-9a63-4e32-9ec1-779e2579ff98 tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2" acquired by "attach_volume" :: waited 0.056s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bd0207b1-9a63-4e32-9ec1-779e2579ff98 tempest-VolumesActionsTest-1958859193 None] Attaching volume 57ef3281-6227-4674-8cc0-0b30a1e406c2 to instance 40f50b34-9fbd-4815-96da-1cea26068987 at mountpoint /dev/vdb on host None. Sep 25 12:46:50 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e 1073741824" returned: 0 in 1.104s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bd0207b1-9a63-4e32-9ec1-779e2579ff98 tempest-VolumesActionsTest-1958859193 None] Attach volume completed successfully. Sep 25 12:46:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bd0207b1-9a63-4e32-9ec1-779e2579ff98 tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2" released by "attach_volume" :: held 0.337s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:50 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e Sep 25 12:46:50 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:51 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" returned: 0 in 0.625s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63dd6b54-cb7f-4438-8af0-c2d531d6f440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2eaffb-5cdd-4e4d-b58a-c663190ae6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Volume volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e (0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e): created successfully Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2eaffb-5cdd-4e4d-b58a-c663190ae6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Flow 'volume_create_manager' (c8e844dc-9b43-4885-bd40-8e788f4bd51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-51dbaebc-09b4-40f8-984f-3267436b2d41 tempest-VolumesTransfersTest-126478208 None] Created volume successfully. Sep 25 12:46:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Terminate volume connection completed successfully. Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" by "detach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Detaching volume 57ef3281-6227-4674-8cc0-0b30a1e406c2 from instance 40f50b34-9fbd-4815-96da-1cea26068987. Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "cinder-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Detach volume completed successfully. Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "cinder-quobyte-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93d38ea3-ecc3-493d-9cf4-bfb3b0730934 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" released by "detach_volume" :: held 0.273s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-quobyte-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b7d3b-bd64-492d-89ea-cb689ee33bb4]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:52 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e Sep 25 12:46:52 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a8861c9c-2d11-4e97-8c63-f1e9e1aa5bcc tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" by "detach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a8861c9c-2d11-4e97-8c63-f1e9e1aa5bcc tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" acquired by "detach_volume" :: waited 0.081s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a8861c9c-2d11-4e97-8c63-f1e9e1aa5bcc tempest-VolumesActionsTest-1958859193 None] Volume detach called, but volume not attached. Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a8861c9c-2d11-4e97-8c63-f1e9e1aa5bcc tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:53 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" returned: 0 in 0.749s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:53 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e Sep 25 12:46:53 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:54 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" returned: 0 in 0.669s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-quobyte-57ef3281-6227-4674-8cc0-0b30a1e406c2" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-quobyte-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e" released by "delete_volume" :: held 1.532s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "cinder-quobyte-57ef3281-6227-4674-8cc0-0b30a1e406c2" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd5eadd-d024-48b4-a910-a56a87aa57a3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Created reservations ['fd065f08-e765-4edb-ab4b-9e8f05877a4e', '354c28ff-f22e-49b6-8a26-f4bf639508a4', '2cd0126e-daa0-4287-bbe3-f6106915cfd8', '1bd30046-3c28-4eb2-a223-1536ab9081f0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:54 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 Sep 25 12:46:54 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:54 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:54 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:54 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2" returned: 0 in 0.712s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:54 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2 Sep 25 12:46:54 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:55 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.715s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Deleted volume successfully. Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-20c54d01-777d-48d3-8776-1dbc5368f287 tempest-VolumesTransfersTest-939365226 None] Lock "cinder-0c0aa4a4-2681-4ec3-b5db-0bdfaa09d47e-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:55 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-57ef3281-6227-4674-8cc0-0b30a1e406c2" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "cinder-quobyte-57ef3281-6227-4674-8cc0-0b30a1e406c2" released by "delete_volume" :: held 1.482s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Created reservations ['b9219830-d31e-4b59-8a28-f2bcd747a45c', '34a400f4-36e0-4782-a195-43f50cae1c2d', '0d2a3616-a8e9-419e-af51-2cb0f8d15c83', 'f29d1c89-0e57-4db0-9fd5-4b75c04a198d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:55 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:46:55 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:56 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.473s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:56 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Deleted volume successfully. Sep 25 12:46:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4246f2b-e0ce-47e2-92c1-9a6d76f8c28b tempest-VolumesActionsTest-1958859193 None] Lock "cinder-57ef3281-6227-4674-8cc0-0b30a1e406c2-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (57b024c1-9eda-4740-9b23-585cc09a643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6ddec2-9bd0-4a99-9bc0-6cf7b7279e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6ddec2-9bd0-4a99-9bc0-6cf7b7279e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354701207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4405a643-492c-4b25-a117-eeab94380689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:04Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d2df7b-8c60-46ee-8e36-1c955a74ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d2df7b-8c60-46ee-8e36-1c955a74ba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bbce30-66ba-4413-b0d4-99e4bee1d926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bbce30-66ba-4413-b0d4-99e4bee1d926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4405a643-492c-4b25-a117-eeab94380689', 'volume_name': 'volume-4405a643-492c-4b25-a117-eeab94380689', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86873663-0153-4870-9eca-7b4d65e262f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86873663-0153-4870-9eca-7b4d65e262f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe9abac-94a1-4edf-b6ce-3479709315aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:03 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Volume 4405a643-492c-4b25-a117-eeab94380689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4405a643-492c-4b25-a117-eeab94380689', 'volume_size': 1} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-354701207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4405a643-492c-4b25-a117-eeab94380689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:04Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Creating volume 4405a643-492c-4b25-a117-eeab94380689 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:03 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:03 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 1073741824 Sep 25 12:47:03 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:04 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 1073741824" returned: 0 in 0.738s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:04 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 Sep 25 12:47:04 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:05 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689" returned: 0 in 0.327s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe9abac-94a1-4edf-b6ce-3479709315aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4405a643-492c-4b25-a117-eeab94380689', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afff63-d82b-4ec2-a5ab-1c8a3e2a49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Volume volume-4405a643-492c-4b25-a117-eeab94380689 (4405a643-492c-4b25-a117-eeab94380689): created successfully Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afff63-d82b-4ec2-a5ab-1c8a3e2a49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (57b024c1-9eda-4740-9b23-585cc09a643d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ec9a57ce-8259-4658-8661-6d887b01a32c tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-4405a643-492c-4b25-a117-eeab94380689-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-4405a643-492c-4b25-a117-eeab94380689-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=95,cinder:UPDATE=116,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=87,cinder:UPDATE=123,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-quobyte-4405a643-492c-4b25-a117-eeab94380689" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-4405a643-492c-4b25-a117-eeab94380689" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e82a8-b767-4643-8af7-403b5e11b7bf]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:06 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 Sep 25 12:47:06 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:06 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:06 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689 Sep 25 12:47:06 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:07 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4405a643-492c-4b25-a117-eeab94380689" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-4405a643-492c-4b25-a117-eeab94380689" released by "delete_volume" :: held 1.022s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Created reservations ['28e17809-4a34-46fd-8a93-9b5cfa366637', '61c2d2a1-54f8-4315-a386-1df08771a75a', 'cc9de163-834f-490c-b569-7c31aecab53c', 'cf2dcf60-4386-4b65-a6fe-75a789fc9233'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:07 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:07 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:07 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:07 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Deleted volume successfully. Sep 25 12:47:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-bfec7a2f-da0f-4681-81e2-715589648000 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-4405a643-492c-4b25-a117-eeab94380689-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (16fc9e25-f0f8-41fc-8de5-b21b34188fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef15f146-cfa5-48c0-a68b-380516a9c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef15f146-cfa5-48c0-a68b-380516a9c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-293551209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161afc71-8337-4738-b825-f16df455bfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:09Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68db3a3d-da33-439c-a48f-4591f8cc17e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68db3a3d-da33-439c-a48f-4591f8cc17e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658f1246-3d13-4e99-ab82-95383eb409a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658f1246-3d13-4e99-ab82-95383eb409a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161afc71-8337-4738-b825-f16df455bfd3', 'volume_name': 'volume-161afc71-8337-4738-b825-f16df455bfd3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d483f4fa-2331-4455-aaf8-e04bb4249a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d483f4fa-2331-4455-aaf8-e04bb4249a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6eca53-6f4a-4e6f-99e8-2c572eb0933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:09 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Volume 161afc71-8337-4738-b825-f16df455bfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161afc71-8337-4738-b825-f16df455bfd3', 'volume_size': 1} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-293551209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161afc71-8337-4738-b825-f16df455bfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:09Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Creating volume 161afc71-8337-4738-b825-f16df455bfd3 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:09 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:09 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 1073741824 Sep 25 12:47:09 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:10 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 1073741824" returned: 0 in 0.733s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:10 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 Sep 25 12:47:10 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:10 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3" returned: 0 in 0.502s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6eca53-6f4a-4e6f-99e8-2c572eb0933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161afc71-8337-4738-b825-f16df455bfd3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8370c04a-042e-4caa-8270-2aa8bc45a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:10 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Volume volume-161afc71-8337-4738-b825-f16df455bfd3 (161afc71-8337-4738-b825-f16df455bfd3): created successfully Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8370c04a-042e-4caa-8270-2aa8bc45a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (16fc9e25-f0f8-41fc-8de5-b21b34188fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a4b9edb1-559e-48da-b4e0-adfc5efae8e3 tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Flow 'volume_create_manager' (1ffdc032-49fe-4620-9fab-5a0c87dd831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e14082-6104-45c1-bd79-8e52966d65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e14082-6104-45c1-bd79-8e52966d65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150557441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a018bb3-23ef-4a5d-8305-34b9424dfd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57b42aacbf4beeab71b96a2c28bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:11Z,use_quota=True,user_id='03cd3b96ef1e4ad7abaf705eab95b712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391668a3-d172-4859-ba93-e94dca6344f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391668a3-d172-4859-ba93-e94dca6344f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9911d3-7c13-4cd6-bb61-376a9a2a7119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9911d3-7c13-4cd6-bb61-376a9a2a7119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a018bb3-23ef-4a5d-8305-34b9424dfd96', 'volume_name': 'volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b9e75-2007-4712-b88c-11841f799346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21b9e75-2007-4712-b88c-11841f799346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb32463f-ed18-4f56-be1d-b539914a2600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:11 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96', 'volume_size': 1} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150557441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a018bb3-23ef-4a5d-8305-34b9424dfd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57b42aacbf4beeab71b96a2c28bc2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:11Z,use_quota=True,user_id='03cd3b96ef1e4ad7abaf705eab95b712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Creating volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:11 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:11 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 1073741824 Sep 25 12:47:11 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-161afc71-8337-4738-b825-f16df455bfd3-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-161afc71-8337-4738-b825-f16df455bfd3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:12 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 1073741824" returned: 0 in 0.962s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-quobyte-161afc71-8337-4738-b825-f16df455bfd3" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-161afc71-8337-4738-b825-f16df455bfd3" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[082f72d3-014d-4d0d-a8b3-9e6fa77d892b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:12 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:47:12 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:12 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 Sep 25 12:47:12 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:12 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.454s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb32463f-ed18-4f56-be1d-b539914a2600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1158b58-df9e-4138-965f-9a0c32b5d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Volume volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 (0a018bb3-23ef-4a5d-8305-34b9424dfd96): created successfully Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1158b58-df9e-4138-965f-9a0c32b5d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Flow 'volume_create_manager' (1ffdc032-49fe-4620-9fab-5a0c87dd831d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dd0c09e4-1134-47e5-9061-385509a8af39 tempest-VolumesActionsTest-610301047 None] Created volume successfully. Sep 25 12:47:12 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3" returned: 0 in 0.667s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:12 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3 Sep 25 12:47:12 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:13 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-161afc71-8337-4738-b825-f16df455bfd3" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-161afc71-8337-4738-b825-f16df455bfd3" released by "delete_volume" :: held 1.184s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Created reservations ['1392adb5-0e9c-4935-a273-af5b492a38d8', 'dfb945d5-1d9a-4de6-bd2a-6c9c306e985b', '26225db6-74db-4856-a41d-9cf81e15f2d6', 'f60325e4-da08-4566-af07-674eb927c11b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:13 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:13 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:13 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.367s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:13 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Deleted volume successfully. Sep 25 12:47:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d0a82d6b-0e1e-445b-b4e3-8a56544ad686 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-161afc71-8337-4738-b825-f16df455bfd3-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (71a68881-2669-4ab4-9984-9842f4649d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb288b7-27fa-441b-8418-87fb151ac41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb288b7-27fa-441b-8418-87fb151ac41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368047132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235e4def-b0c4-495a-bb3b-8688b0b31324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:15Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d43cd-11cc-4d28-96bb-a89bcbfaeecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d43cd-11cc-4d28-96bb-a89bcbfaeecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30847247-452d-4394-bf50-356424791059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30847247-452d-4394-bf50-356424791059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235e4def-b0c4-495a-bb3b-8688b0b31324', 'volume_name': 'volume-235e4def-b0c4-495a-bb3b-8688b0b31324', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa23374-3f32-4a62-a01e-04d753121ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa23374-3f32-4a62-a01e-04d753121ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bbbb74-c8bc-40c0-bfcd-f2db258458f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Volume 235e4def-b0c4-495a-bb3b-8688b0b31324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235e4def-b0c4-495a-bb3b-8688b0b31324', 'volume_size': 1} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368047132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235e4def-b0c4-495a-bb3b-8688b0b31324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:15Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Creating volume 235e4def-b0c4-495a-bb3b-8688b0b31324 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:15 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 1073741824 Sep 25 12:47:15 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:16 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 1073741824" returned: 0 in 0.679s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:16 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 Sep 25 12:47:16 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:16 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324" returned: 0 in 0.372s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bbbb74-c8bc-40c0-bfcd-f2db258458f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235e4def-b0c4-495a-bb3b-8688b0b31324', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5683fc4-9db8-441e-8009-68446bfe8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Volume volume-235e4def-b0c4-495a-bb3b-8688b0b31324 (235e4def-b0c4-495a-bb3b-8688b0b31324): created successfully Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5683fc4-9db8-441e-8009-68446bfe8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (71a68881-2669-4ab4-9984-9842f4649d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-54395286-7ee6-4b3f-bb7c-e00f3be59a36 tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-235e4def-b0c4-495a-bb3b-8688b0b31324-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-235e4def-b0c4-495a-bb3b-8688b0b31324-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-quobyte-235e4def-b0c4-495a-bb3b-8688b0b31324" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-235e4def-b0c4-495a-bb3b-8688b0b31324" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f106d87-1889-4f7a-a3ad-b9222723dce2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:17 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 Sep 25 12:47:17 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:18 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324" returned: 0 in 0.560s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:18 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324 Sep 25 12:47:18 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:18 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-235e4def-b0c4-495a-bb3b-8688b0b31324" returned: 0 in 0.341s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-235e4def-b0c4-495a-bb3b-8688b0b31324" released by "delete_volume" :: held 1.004s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Created reservations ['68da0068-d869-4e3c-b9ea-65b4c659aaa7', '0c9bba1b-6e0a-4355-be53-0bdab0b0a972', '727e20b7-6871-46d4-a1d7-97d75f961794', '732bd801-9c50-4c76-b082-706cb9e0d52a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:19 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:19 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:19 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.361s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Deleted volume successfully. Sep 25 12:47:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-707b4597-6e68-4757-9273-f12e9f48d662 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-235e4def-b0c4-495a-bb3b-8688b0b31324-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (ff8744c8-e160-4c1f-bba8-6a2a167281b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ef5c52-8638-45b8-b9f1-bb83463ed27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ef5c52-8638-45b8-b9f1-bb83463ed27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-853951807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895a551f-0e77-403a-9cd8-9d87ad67b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:21Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0e7cef-b796-42fb-9e47-eee8b99ce5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0e7cef-b796-42fb-9e47-eee8b99ce5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8108f018-5338-4722-9782-9c26e46f3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8108f018-5338-4722-9782-9c26e46f3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895a551f-0e77-403a-9cd8-9d87ad67b957', 'volume_name': 'volume-895a551f-0e77-403a-9cd8-9d87ad67b957', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a3bcb5-0d55-48c4-a9ff-2dd43e91c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a3bcb5-0d55-48c4-a9ff-2dd43e91c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9545bf1d-fde8-4bd6-a128-1a958f5b7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Volume 895a551f-0e77-403a-9cd8-9d87ad67b957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895a551f-0e77-403a-9cd8-9d87ad67b957', 'volume_size': 1} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-853951807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895a551f-0e77-403a-9cd8-9d87ad67b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:21Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Creating volume 895a551f-0e77-403a-9cd8-9d87ad67b957 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:21 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:21 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 1073741824 Sep 25 12:47:21 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:21 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 1073741824" returned: 0 in 0.754s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:22 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 Sep 25 12:47:22 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:22 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957" returned: 0 in 0.380s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9545bf1d-fde8-4bd6-a128-1a958f5b7e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895a551f-0e77-403a-9cd8-9d87ad67b957', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c632ab6-7cdc-4fc7-8fbc-912deee4e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Volume volume-895a551f-0e77-403a-9cd8-9d87ad67b957 (895a551f-0e77-403a-9cd8-9d87ad67b957): created successfully Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c632ab6-7cdc-4fc7-8fbc-912deee4e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (ff8744c8-e160-4c1f-bba8-6a2a167281b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fd8f9527-a58b-4034-b6ca-1fdba1c1c48b tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-895a551f-0e77-403a-9cd8-9d87ad67b957-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-895a551f-0e77-403a-9cd8-9d87ad67b957-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "cinder-quobyte-895a551f-0e77-403a-9cd8-9d87ad67b957" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-895a551f-0e77-403a-9cd8-9d87ad67b957" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fcf025-2628-46fe-9104-a00ae96c65c0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:23 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 Sep 25 12:47:23 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:24 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957" returned: 0 in 0.559s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:24 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957 Sep 25 12:47:24 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:24 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-895a551f-0e77-403a-9cd8-9d87ad67b957" returned: 0 in 0.432s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-quobyte-895a551f-0e77-403a-9cd8-9d87ad67b957" released by "delete_volume" :: held 1.060s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Created reservations ['d652d288-1112-4a0f-8790-6843071e4654', '86e944c1-ea22-40c5-86d0-21d491bd50ce', '36b872af-fee4-45c2-8514-066bae15297a', '9ece41ef-6e70-409c-a43c-ea9368a054ec'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:25 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:25 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:25 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.334s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:25 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Deleted volume successfully. Sep 25 12:47:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5d72f38-ea5b-4675-bc59-60ca23ca3a26 tempest-VolumesActionsTest-1314745930 None] Lock "cinder-895a551f-0e77-403a-9cd8-9d87ad67b957-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (abbf6401-882c-48b7-a404-fbc752140a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f3ed84-fcae-4937-bb3f-2242cd3cc893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f3ed84-fcae-4937-bb3f-2242cd3cc893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090495495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1b9bc6-c9b9-46f4-a782-1950af9f4f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:27Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419e88f7-eb5e-4d9f-958b-017832be9e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419e88f7-eb5e-4d9f-958b-017832be9e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfacd03-78a6-4308-9465-be2fe6e594d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfacd03-78a6-4308-9465-be2fe6e594d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1b9bc6-c9b9-46f4-a782-1950af9f4f79', 'volume_name': 'volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bde35e-b9eb-4ee6-ba23-9909f274ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bde35e-b9eb-4ee6-ba23-9909f274ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c0a54-8835-483e-9306-4bfb584440e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Volume 6f1b9bc6-c9b9-46f4-a782-1950af9f4f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79', 'volume_size': 1} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090495495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1b9bc6-c9b9-46f4-a782-1950af9f4f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf4ad1b9f1042669f80eeff78f3807a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:27Z,use_quota=True,user_id='789086e6ced34963b32d539576653a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Creating volume 6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:26 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:47:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:26 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 1073741824 Sep 25 12:47:26 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:27 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 1073741824" returned: 0 in 0.807s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:27 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 Sep 25 12:47:27 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:28 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" returned: 0 in 0.537s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c0a54-8835-483e-9306-4bfb584440e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f74fc8-0487-4ffd-bf73-3438d8259a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Volume volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 (6f1b9bc6-c9b9-46f4-a782-1950af9f4f79): created successfully Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f74fc8-0487-4ffd-bf73-3438d8259a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Flow 'volume_create_manager' (abbf6401-882c-48b7-a404-fbc752140a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3096cf49-615c-4d30-813d-08431f53e0a1 tempest-VolumesActionsTest-1958859193 None] Created volume successfully. Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "cinder-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Acquiring lock "cinder-quobyte-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "cinder-quobyte-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd0d0c-c16c-4ce4-9dac-c12c74eb49ec]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:30 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 Sep 25 12:47:30 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:30 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" returned: 0 in 0.573s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:31 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79 Sep 25 12:47:31 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:31 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" returned: 0 in 0.586s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "cinder-quobyte-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79" released by "delete_volume" :: held 1.263s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Created reservations ['d6c6b330-ebf2-4b7a-aa12-0efb1cd9eb0d', '505ae3d8-78f5-464a-b4ef-44d8e847e109', '70fd3c3f-91e7-4be3-9121-a0389103c88e', '42f04376-52bd-41fd-8e3c-cee0e0ef2109'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:32 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:32 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:32 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.730s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Deleted volume successfully. Sep 25 12:47:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2408c468-1fb1-4cae-86c3-25b4f00ccfdb tempest-VolumesActionsTest-1958859193 None] Lock "cinder-6f1b9bc6-c9b9-46f4-a782-1950af9f4f79-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fb5cbb9f-86bb-4c6a-96ee-9914d7401b82 tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" by "attach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fb5cbb9f-86bb-4c6a-96ee-9914d7401b82 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" acquired by "attach_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fb5cbb9f-86bb-4c6a-96ee-9914d7401b82 tempest-VolumesActionsTest-610301047 None] Attaching volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96 to instance e5a15c1b-020d-4274-9ab4-202ac61d8ceb at mountpoint /dev/vdb on host None. Sep 25 12:47:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fb5cbb9f-86bb-4c6a-96ee-9914d7401b82 tempest-VolumesActionsTest-610301047 None] Attach volume completed successfully. Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fb5cbb9f-86bb-4c6a-96ee-9914d7401b82 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" released by "attach_volume" :: held 0.182s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dce07cf-fc09-4800-9f9e-4f98a83d8fd6 tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" by "detach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dce07cf-fc09-4800-9f9e-4f98a83d8fd6 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4dce07cf-fc09-4800-9f9e-4f98a83d8fd6 tempest-VolumesActionsTest-610301047 None] Detaching volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96 from instance e5a15c1b-020d-4274-9ab4-202ac61d8ceb. Sep 25 12:47:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4dce07cf-fc09-4800-9f9e-4f98a83d8fd6 tempest-VolumesActionsTest-610301047 None] Detach volume completed successfully. Sep 25 12:47:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dce07cf-fc09-4800-9f9e-4f98a83d8fd6 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:47 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:47:47 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:47 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.539s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:47:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:47:49 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=48,cinder:DELETE=7 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:47:49 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=39,cinder:INSERT=14,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (85758a80-7b32-49d0-8a5d-5a4930e4d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca44045-2793-4a6b-87fd-f86c88abb6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca44045-2793-4a6b-87fd-f86c88abb6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1691998347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f64266-4b6e-4578-bc69-c764fec389cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:03Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3edeebfa-0ecd-4fa2-9798-6f0f623907ee),volume_type_id=3edeebfa-0ecd-4fa2-9798-6f0f623907ee)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399ed035-b2d1-4f0c-b0e9-212b37571989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399ed035-b2d1-4f0c-b0e9-212b37571989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174f45-854e-443d-92bc-0983c7829d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174f45-854e-443d-92bc-0983c7829d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f64266-4b6e-4578-bc69-c764fec389cf', 'volume_name': 'volume-58f64266-4b6e-4578-bc69-c764fec389cf', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed83426-423f-4d27-a182-31c93e50f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed83426-423f-4d27-a182-31c93e50f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e7e2b-8818-4062-be38-f2090a803412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume 58f64266-4b6e-4578-bc69-c764fec389cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f64266-4b6e-4578-bc69-c764fec389cf', 'volume_size': 1} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1691998347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f64266-4b6e-4578-bc69-c764fec389cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:03Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3edeebfa-0ecd-4fa2-9798-6f0f623907ee),volume_type_id=3edeebfa-0ecd-4fa2-9798-6f0f623907ee)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Creating volume 58f64266-4b6e-4578-bc69-c764fec389cf {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:03 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:03 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf 1073741824 Sep 25 12:48:03 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (a85c606d-b455-4289-b135-3da92a2cd942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b770cb7-5ea8-4491-bcaa-137cc279abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b770cb7-5ea8-4491-bcaa-137cc279abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1591577705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fb14a-4f16-42f4-8e72-faefccf004b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:04Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2833747f-7b19-404d-aa81-903ea34b1c55),volume_type_id=2833747f-7b19-404d-aa81-903ea34b1c55)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e51ef-0775-42ab-a3d0-62d8de2fe645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e51ef-0775-42ab-a3d0-62d8de2fe645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116050a2-af88-4e82-a292-5939bf616872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116050a2-af88-4e82-a292-5939bf616872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2fb14a-4f16-42f4-8e72-faefccf004b6', 'volume_name': 'volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d0dbee-1778-4b83-8357-9328651f5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d0dbee-1778-4b83-8357-9328651f5980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0f53d2-881c-4f10-a627-678b7098e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume 1a2fb14a-4f16-42f4-8e72-faefccf004b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6', 'volume_size': 1} Sep 25 12:48:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:04 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf 1073741824" returned: 0 in 1.231s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:04 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf Sep 25 12:48:04 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf" returned: 0 in 0.490s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:04 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1591577705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fb14a-4f16-42f4-8e72-faefccf004b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:04Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2833747f-7b19-404d-aa81-903ea34b1c55),volume_type_id=2833747f-7b19-404d-aa81-903ea34b1c55)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Creating volume 1a2fb14a-4f16-42f4-8e72-faefccf004b6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:04 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:05 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 1073741824 Sep 25 12:48:05 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226e7e2b-8818-4062-be38-f2090a803412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f64266-4b6e-4578-bc69-c764fec389cf', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820ffa33-7484-44d9-82fe-8037b15d8302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume volume-58f64266-4b6e-4578-bc69-c764fec389cf (58f64266-4b6e-4578-bc69-c764fec389cf): created successfully Sep 25 12:48:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820ffa33-7484-44d9-82fe-8037b15d8302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (85758a80-7b32-49d0-8a5d-5a4930e4d61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-81b99422-0a60-4977-a4c4-09e98f185e81 tempest-TestInstancesWithCinderVolumes-757105088 None] Created volume successfully. Sep 25 12:48:06 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 1073741824" returned: 0 in 1.533s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:06 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 Sep 25 12:48:06 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (a6d9ee25-b47b-4a47-9e77-df5d36aef2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880ab5b-36f0-4876-97d9-13c008d3e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880ab5b-36f0-4876-97d9-13c008d3e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1772155197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f157930-e78d-401d-8db1-ea553aadb8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:07Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f19038-c04e-43b9-a700-fcc30d69c66d),volume_type_id=a3f19038-c04e-43b9-a700-fcc30d69c66d)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a676de0c-dd2e-43d8-af49-289cac6a287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a676de0c-dd2e-43d8-af49-289cac6a287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722905a-ba82-4162-943a-f59c17212838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:48:07 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6" returned: 0 in 0.549s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0f53d2-881c-4f10-a627-678b7098e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1456cf7e-cae1-43f1-a7c5-cec39c298d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Volume volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 (1a2fb14a-4f16-42f4-8e72-faefccf004b6): created successfully Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1456cf7e-cae1-43f1-a7c5-cec39c298d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (a85c606d-b455-4289-b135-3da92a2cd942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e04e3e4a-88f4-4a05-8836-cc0bb42473b2 tempest-TestInstancesWithCinderVolumes-757105088 None] Created volume successfully. Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9722905a-ba82-4162-943a-f59c17212838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f157930-e78d-401d-8db1-ea553aadb8de', 'volume_name': 'volume-9f157930-e78d-401d-8db1-ea553aadb8de', 'volume_size': 1, 'image_id': '510d0669-0349-4836-9307-633af0bb5695', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083006638', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '249950fb309e4f79b8d9ed1fe97b87c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '510d0669-0349-4836-9307-633af0bb5695', 'created_at': datetime.datetime(2026, 9, 25, 10, 47, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/510d0669-0349-4836-9307-633af0bb5695/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaca047-f941-439a-b9d3-4d17e5188d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abaca047-f941-439a-b9d3-4d17e5188d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd883cd3-44de-412e-9fb1-b201125aea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Volume 9f157930-e78d-401d-8db1-ea553aadb8de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f157930-e78d-401d-8db1-ea553aadb8de', 'volume_size': 1, 'image_id': '510d0669-0349-4836-9307-633af0bb5695', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083006638', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '249950fb309e4f79b8d9ed1fe97b87c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '510d0669-0349-4836-9307-633af0bb5695', 'created_at': datetime.datetime(2026, 9, 25, 10, 47, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/510d0669-0349-4836-9307-633af0bb5695/file', 'properties': {}}, 'image_service': } Sep 25 12:48:07 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Trying to clone 9f157930-e78d-401d-8db1-ea553aadb8de from image 510d0669-0349-4836-9307-633af0bb5695 at location (None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Flow 'volume_create_manager' (14dea65f-186e-481f-906a-f7600784baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f15e8a-3ea1-467a-abd5-d1ab6458c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f15e8a-3ea1-467a-abd5-d1ab6458c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-6200222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce35f3a5-effe-48bd-b08f-bfefeee5879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d8195980394f2cb1d3e3b4f30fd007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:08Z,use_quota=True,user_id='230d35e4e8474d318ae8ef5d4b0e39fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ff1308-592f-4e33-8d72-8973b7548ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ff1308-592f-4e33-8d72-8973b7548ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c91d297-ff79-49a3-b0c7-9f41e054eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c91d297-ff79-49a3-b0c7-9f41e054eba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce35f3a5-effe-48bd-b08f-bfefeee5879b', 'volume_name': 'volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905caef0-45a9-4e87-9104-060ca694ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905caef0-45a9-4e87-9104-060ca694ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903a77c-d744-454b-8835-831e17e3d3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Volume ce35f3a5-effe-48bd-b08f-bfefeee5879b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b', 'volume_size': 1} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-6200222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce35f3a5-effe-48bd-b08f-bfefeee5879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d8195980394f2cb1d3e3b4f30fd007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:08Z,use_quota=True,user_id='230d35e4e8474d318ae8ef5d4b0e39fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Creating volume ce35f3a5-effe-48bd-b08f-bfefeee5879b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:08 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:08 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b 1073741824 Sep 25 12:48:08 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:08 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b 1073741824" returned: 0 in 0.712s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:09 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b Sep 25 12:48:09 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:09 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b" returned: 0 in 0.359s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f903a77c-d744-454b-8835-831e17e3d3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5bde87-fe97-4ff3-b685-fe79874fbd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:09 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Volume volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b (ce35f3a5-effe-48bd-b08f-bfefeee5879b): created successfully Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5bde87-fe97-4ff3-b685-fe79874fbd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Flow 'volume_create_manager' (14dea65f-186e-481f-906a-f7600784baea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b5ab826f-241d-44c7-a26c-f515960648fa tempest-VolumesMetadataTest-1551916116 None] Created volume successfully. Sep 25 12:48:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72128004-8c27-4b61-8ef8-7b5f6eeadc67 tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" by "attach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72128004-8c27-4b61-8ef8-7b5f6eeadc67 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" acquired by "attach_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72128004-8c27-4b61-8ef8-7b5f6eeadc67 tempest-VolumesActionsTest-610301047 None] Attaching volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96 to instance 1b9c1a0d-1eb3-4ece-bfbb-811efa61bef4 at mountpoint /dev/vdb on host None. Sep 25 12:48:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72128004-8c27-4b61-8ef8-7b5f6eeadc67 tempest-VolumesActionsTest-610301047 None] Attach volume completed successfully. Sep 25 12:48:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72128004-8c27-4b61-8ef8-7b5f6eeadc67 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96" released by "attach_volume" :: held 0.220s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db8aec0c-5af5-4723-9296-77c09c329e9b tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" by "detach_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db8aec0c-5af5-4723-9296-77c09c329e9b tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db8aec0c-5af5-4723-9296-77c09c329e9b tempest-VolumesActionsTest-610301047 None] Detaching volume 0a018bb3-23ef-4a5d-8305-34b9424dfd96 from instance 1b9c1a0d-1eb3-4ece-bfbb-811efa61bef4. Sep 25 12:48:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db8aec0c-5af5-4723-9296-77c09c329e9b tempest-VolumesActionsTest-610301047 None] Detach volume completed successfully. Sep 25 12:48:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db8aec0c-5af5-4723-9296-77c09c329e9b tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Acquiring lock "cinder-ce35f3a5-effe-48bd-b08f-bfefeee5879b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "cinder-ce35f3a5-effe-48bd-b08f-bfefeee5879b-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Acquiring lock "cinder-quobyte-ce35f3a5-effe-48bd-b08f-bfefeee5879b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "cinder-quobyte-ce35f3a5-effe-48bd-b08f-bfefeee5879b" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b3b330-ce0b-4aa0-880b-79e39428d98e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:12 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b Sep 25 12:48:12 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:13 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b" returned: 0 in 0.804s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:13 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b Sep 25 12:48:13 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:13 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ce35f3a5-effe-48bd-b08f-bfefeee5879b" returned: 0 in 0.661s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "cinder-quobyte-ce35f3a5-effe-48bd-b08f-bfefeee5879b" released by "delete_volume" :: held 1.556s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Created reservations ['73d8dea2-95b6-4e89-a6ec-f8ffd178b0d7', '43ca823a-4450-4604-9210-d53eed69e35f', '4a9adf01-6cdb-45a9-a6be-848d9f9670af', '8de28f89-fa84-4089-abb8-f451cba5ce41'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:14 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:48:14 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:14 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.429s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Deleted volume successfully. Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-56b557dc-e379-45b0-bc19-8517bc8c8496 tempest-VolumesMetadataTest-1551916116 None] Lock "cinder-ce35f3a5-effe-48bd-b08f-bfefeee5879b-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD, size 20.69 MB, duration 7.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:48:14 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Image download 20.69 MB at 2.95 MB/s Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf37589-825c-4d2e-a581-bc59f53aff24]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:14 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD Sep 25 12:48:14 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:15 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Temporary image 510d0669-0349-4836-9307-633af0bb5695 is fetched for user c176678e707346b081ec229821d98118. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086dd12-f2f8-4a83-ade2-65ab42a8a10b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:15 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD Sep 25 12:48:15 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Flow 'volume_create_manager' (f4fdb294-fbae-44f9-8e83-d8536ec3e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b4b65e-95e6-4db1-95e1-541d83cb2a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b4b65e-95e6-4db1-95e1-541d83cb2a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-724160895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecdacb0-1610-4efd-b022-b6d032488d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c2e36292194f64bd279adac4140cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:15Z,use_quota=True,user_id='a0bd38c8d6834c86b4d96a0f82e5f0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a244ad09-0b18-410d-bbc7-5e8a685c78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a244ad09-0b18-410d-bbc7-5e8a685c78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44693514-943b-441f-8750-6424ca49ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44693514-943b-441f-8750-6424ca49ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecdacb0-1610-4efd-b022-b6d032488d70', 'volume_name': 'volume-9ecdacb0-1610-4efd-b022-b6d032488d70', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276df9d2-2135-4867-bc76-10a6386c8c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276df9d2-2135-4867-bc76-10a6386c8c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a8d1b-b382-4e67-9e64-8c92e84cf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Volume 9ecdacb0-1610-4efd-b022-b6d032488d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecdacb0-1610-4efd-b022-b6d032488d70', 'volume_size': 1} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-724160895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecdacb0-1610-4efd-b022-b6d032488d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c2e36292194f64bd279adac4140cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:15Z,use_quota=True,user_id='a0bd38c8d6834c86b4d96a0f82e5f0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Creating volume 9ecdacb0-1610-4efd-b022-b6d032488d70 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:15 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 1073741824 Sep 25 12:48:15 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:15 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:16 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 1073741824" returned: 0 in 0.662s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:16 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 Sep 25 12:48:16 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:16 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1772155197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f157930-e78d-401d-8db1-ea553aadb8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249950fb309e4f79b8d9ed1fe97b87c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:07Z,use_quota=True,user_id='c176678e707346b081ec229821d98118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f19038-c04e-43b9-a700-fcc30d69c66d),volume_type_id=a3f19038-c04e-43b9-a700-fcc30d69c66d)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Creating volume 9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:16 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a8d1b-b382-4e67-9e64-8c92e84cf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecdacb0-1610-4efd-b022-b6d032488d70', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9091f4-ffc6-431d-b801-5acc313642a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:16 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1073741824 Sep 25 12:48:16 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Volume volume-9ecdacb0-1610-4efd-b022-b6d032488d70 (9ecdacb0-1610-4efd-b022-b6d032488d70): created successfully Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9091f4-ffc6-431d-b801-5acc313642a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Flow 'volume_create_manager' (f4fdb294-fbae-44f9-8e83-d8536ec3e04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ee981e4f-d5a2-49ca-9f6f-9d6fc9609b20 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Created volume successfully. Sep 25 12:48:17 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1073741824" returned: 0 in 0.622s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:17 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de Sep 25 12:48:17 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:17 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de" returned: 0 in 0.448s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.183s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ebcc1-e5ad-4814-b2e3-ab315818b03d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Attempting download of 510d0669-0349-4836-9307-633af0bb5695 ((None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}])) to volume 9f157930-e78d-401d-8db1-ea553aadb8de. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd404a15-b11b-4280-bf00-694b2a621a3c]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:18 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:48:18 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:18 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t Sep 25 12:48:18 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:18 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.562s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc87e4-bd41-42b5-81ce-2b746b95eb34]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:18 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-7895a9bb-b532-436f-a3e0-b1c0e87743ae req-158c5c94-ae37-4935-88af-4a402bfa8f87 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:18 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t Sep 25 12:48:18 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:18 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:48:18 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:19 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t" returned: 1 in 0.414s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_510d0669-0349-4836-9307-633af0bb5695_p2du_q5t' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d10692-5661-4740-9ba9-69c838a95423]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:19 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.591s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.5b2ba77c-7b01-424a-a0e1-675d7da3bc86zghythsf.img {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:19 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD Sep 25 12:48:19 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:19 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.5b2ba77c-7b01-424a-a0e1-675d7da3bc86zghythsf.img Sep 25 12:48:19 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:19 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] 510d0669-0349-4836-9307-633af0bb5695 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:48:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:19 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de Sep 25 12:48:19 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Flow 'volume_create_manager' (93e640fa-ab55-4cdc-8552-5bdf499e5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a5e028-811d-4bf9-827c-63e82d5ab36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a5e028-811d-4bf9-827c-63e82d5ab36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-817528838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecedd8a9870f41ed98d3f993833de58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:24Z,use_quota=True,user_id='aae96fe04b9246beb28220994ea5f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76e3038-de5a-496d-924d-555e96098717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76e3038-de5a-496d-924d-555e96098717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab40c264-a100-4d1e-8d48-a93ce52dc467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab40c264-a100-4d1e-8d48-a93ce52dc467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3', 'volume_name': 'volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e3bfe-3bb3-4cb0-a991-b74db0aad554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24e3bfe-3bb3-4cb0-a991-b74db0aad554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e1d7c9-9a93-43cf-9868-8906e2ffd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:24 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Volume 46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3', 'volume_size': 1} Sep 25 12:48:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:25 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de" returned: 0 in 5.858s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:25 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_510d0669-0349-4836-9307-633af0bb5695_dwi48r5fdevstack@QuobyteHD, size 112.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:48:25 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Converted 112.00 MB image at 19.11 MB/s Sep 25 12:48:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:25 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1G Sep 25 12:48:25 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:26 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de 1G" returned: 0 in 0.725s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Downloaded image 510d0669-0349-4836-9307-633af0bb5695 ((None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}])) to volume 9f157930-e78d-401d-8db1-ea553aadb8de successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Temporary image 510d0669-0349-4836-9307-633af0bb5695 for user c176678e707346b081ec229821d98118 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Marking volume 9f157930-e78d-401d-8db1-ea553aadb8de as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Copying metadata from image 510d0669-0349-4836-9307-633af0bb5695 to 9f157930-e78d-401d-8db1-ea553aadb8de. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Creating volume glance metadata for volume 9f157930-e78d-401d-8db1-ea553aadb8de backed by image 510d0669-0349-4836-9307-633af0bb5695 with: {'image_id': '510d0669-0349-4836-9307-633af0bb5695', 'image_name': 'tempest-scenario-img--1083006638', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd883cd3-44de-412e-9fb1-b201125aea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f157930-e78d-401d-8db1-ea553aadb8de', 'volume_size': 1, 'image_id': '510d0669-0349-4836-9307-633af0bb5695', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/510d0669-0349-4836-9307-633af0bb5695', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083006638', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '249950fb309e4f79b8d9ed1fe97b87c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '510d0669-0349-4836-9307-633af0bb5695', 'created_at': datetime.datetime(2026, 9, 25, 10, 47, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 48, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/510d0669-0349-4836-9307-633af0bb5695/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9001be2-5264-42d2-9ae7-9d2bf66e0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Volume volume-9f157930-e78d-401d-8db1-ea553aadb8de (9f157930-e78d-401d-8db1-ea553aadb8de): created successfully Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9001be2-5264-42d2-9ae7-9d2bf66e0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Flow 'volume_create_manager' (a6d9ee25-b47b-4a47-9e77-df5d36aef2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d22ef490-5c83-489f-a10b-8b0dfb552f1f tempest-TestInstancesWithCinderVolumes-757105088 None] Created volume successfully. Sep 25 12:48:27 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.5b2ba77c-7b01-424a-a0e1-675d7da3bc86zghythsf.img" returned: 0 in 8.024s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e554d1e3-8650-4960-9f11-7684007c76de]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:27 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:48:27 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:27 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.678s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96, size 1024.00 MB, duration 8.03 sec, destination /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.5b2ba77c-7b01-424a-a0e1-675d7da3bc86zghythsf.img {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:48:27 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Converted 1024.00 MB image at 127.59 MB/s Sep 25 12:48:27 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] 5b2ba77c-7b01-424a-a0e1-675d7da3bc86 was raw, no need to convert to raw {{(pid=87094) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 12:48:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b4f5f958-8891-418f-bcbc-93d6685ea014 req-95506e11-e367-49dd-a8d1-71274881e575 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:40 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=29,cinder:UPDATE=18,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:48:40 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:47 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:48:47 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:47 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.336s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:48:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.546s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Uploaded volume to glance image-id: 5b2ba77c-7b01-424a-a0e1-675d7da3bc86. {{(pid=87094) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-7895a9bb-b532-436f-a3e0-b1c0e87743ae req-158c5c94-ae37-4935-88af-4a402bfa8f87 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 32.779s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-7895a9bb-b532-436f-a3e0-b1c0e87743ae req-158c5c94-ae37-4935-88af-4a402bfa8f87 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.531s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-817528838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecedd8a9870f41ed98d3f993833de58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:24Z,use_quota=True,user_id='aae96fe04b9246beb28220994ea5f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Creating volume 46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:51 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ab1b2556-7ebe-4a1a-ab6a-c56b0b7e768d tempest-VolumesActionsTest-610301047 None] Copy volume to image completed successfully. Sep 25 12:48:51 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 1073741824 Sep 25 12:48:51 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-7895a9bb-b532-436f-a3e0-b1c0e87743ae req-158c5c94-ae37-4935-88af-4a402bfa8f87 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-9ecdacb0-1610-4efd-b022-b6d032488d70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a87b5254-9aa7-44ce-a1c9-09adc12e874a', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:48:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-7895a9bb-b532-436f-a3e0-b1c0e87743ae req-158c5c94-ae37-4935-88af-4a402bfa8f87 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] attachment_update completed successfully. Sep 25 12:48:52 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 1073741824" returned: 0 in 0.706s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:52 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 Sep 25 12:48:52 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:52 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" returned: 0 in 0.327s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b4f5f958-8891-418f-bcbc-93d6685ea014 req-95506e11-e367-49dd-a8d1-71274881e575 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.685s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-b4f5f958-8891-418f-bcbc-93d6685ea014 req-95506e11-e367-49dd-a8d1-71274881e575 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e1d7c9-9a93-43cf-9868-8906e2ffd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3764ab28-09de-4bef-ac35-8ec48b3c7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:52 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Volume volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 (46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3): created successfully Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3764ab28-09de-4bef-ac35-8ec48b3c7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Flow 'volume_create_manager' (93e640fa-ab55-4cdc-8552-5bdf499e5418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-167b9a1e-48a8-45f8-a20e-d5d50c756457 tempest-VolumesTransfersV355Test-732493014 None] Created volume successfully. Sep 25 12:48:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-b4f5f958-8891-418f-bcbc-93d6685ea014 req-95506e11-e367-49dd-a8d1-71274881e575 tempest-TestInstancesWithCinderVolumes-757105088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-9f157930-e78d-401d-8db1-ea553aadb8de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb5ec664-c73c-4e01-b018-7f051fe2e8b9', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:48:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-b4f5f958-8891-418f-bcbc-93d6685ea014 req-95506e11-e367-49dd-a8d1-71274881e575 tempest-TestInstancesWithCinderVolumes-757105088 None] attachment_update completed successfully. Sep 25 12:48:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[513cf987-a3c8-4909-9f27-99fa7c3d7296]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:54 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:48:54 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:55 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 1.109s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c451435a-ce58-41cc-a7ad-7e70560a9b59]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:55 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:48:55 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:56 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.528s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:56 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img Sep 25 12:48:56 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8029f33b-a977-4659-b3ad-2af1fbde69f9 tempest-VolumesTransfersV355Test-152811169 None] Transfer volume completed successfully. Sep 25 12:48:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-e218e7bb-8a4f-42e2-b3fa-fd9b8a261d24 req-2aeaa962-47ef-43a4-95ac-f4bd3c894402 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Terminate volume connection completed successfully. Sep 25 12:48:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-e218e7bb-8a4f-42e2-b3fa-fd9b8a261d24 req-2aeaa962-47ef-43a4-95ac-f4bd3c894402 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Deleting attachment a87b5254-9aa7-44ce-a1c9-09adc12e874a. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:48:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "cinder-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "cinder-quobyte-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-quobyte-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" acquired by "delete_volume" :: waited 0.089s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[82827cb8-8ceb-4db5-98af-5d01d414dc5d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:59 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 Sep 25 12:48:59 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "cinder-9ecdacb0-1610-4efd-b022-b6d032488d70-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "cinder-9ecdacb0-1610-4efd-b022-b6d032488d70-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "cinder-quobyte-9ecdacb0-1610-4efd-b022-b6d032488d70" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "cinder-quobyte-9ecdacb0-1610-4efd-b022-b6d032488d70" acquired by "delete_volume" :: waited 0.051s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e33beb-ca7b-4ebc-bc16-4e97049c977a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:00 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" returned: 0 in 1.563s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:00 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 Sep 25 12:49:00 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:00 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3 Sep 25 12:49:00 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:01 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" returned: 0 in 0.936s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-quobyte-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3" released by "delete_volume" :: held 2.738s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:01 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70" returned: 0 in 1.583s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:01 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70 Sep 25 12:49:01 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:01 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Created reservations ['9f61e879-20f7-4730-a3df-64013bc4cb5c', '3402ac01-0602-41e9-8a7b-0b354e3e6c3e', '659f21f7-660d-40bd-b224-1e13a16b942c', 'a5f69afd-a2a8-4388-9b28-99cbd2d27bdd'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:02 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:02 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:02 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9ecdacb0-1610-4efd-b022-b6d032488d70" returned: 0 in 0.783s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "cinder-quobyte-9ecdacb0-1610-4efd-b022-b6d032488d70" released by "delete_volume" :: held 2.610s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:02 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:02 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Deleted volume successfully. Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e64ff53d-ab52-4eb5-9a82-8972a2cceec6 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-46d01cc9-7aa1-45c1-bec9-c1e611a1a1d3-delete_volume" released by "delete_volume" :: held 4.500s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Created reservations ['75c7acb1-6d15-4f0b-b869-6c01d6785270', '279a8ebf-eaee-4d5a-9043-7fa02885ba8e', 'db77dc3a-7800-45df-b54b-6adfcebc0fd3', '3cb30548-d443-40e7-8064-37626ca94603'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:03 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:03 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:04 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.862s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:04 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Deleted volume successfully. Sep 25 12:49:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5b69b274-fe19-4731-8305-e06e66c686f3 tempest-TestServerVolumeAttachScenarioOldVersion-1231604695 None] Lock "cinder-9ecdacb0-1610-4efd-b022-b6d032488d70-delete_volume" released by "delete_volume" :: held 4.756s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Flow 'volume_create_manager' (85e2ff89-0b63-4bde-a8f3-346bc11eb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa9a8d7-e0b0-4c2e-8b52-e862874fc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa9a8d7-e0b0-4c2e-8b52-e862874fc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095897449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395b0b70-1d29-442f-a134-cdba855334fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecedd8a9870f41ed98d3f993833de58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:05Z,use_quota=True,user_id='aae96fe04b9246beb28220994ea5f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc9629d-2528-4c26-99f6-7155a012b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc9629d-2528-4c26-99f6-7155a012b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c2c393-f882-4f39-a1fe-f9189a62a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c2c393-f882-4f39-a1fe-f9189a62a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395b0b70-1d29-442f-a134-cdba855334fc', 'volume_name': 'volume-395b0b70-1d29-442f-a134-cdba855334fc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6148cb6f-7403-49d6-aac3-c2e524269310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6148cb6f-7403-49d6-aac3-c2e524269310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4eb4a3-6a92-462d-be23-17ed7693cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Volume 395b0b70-1d29-442f-a134-cdba855334fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395b0b70-1d29-442f-a134-cdba855334fc', 'volume_size': 1} Sep 25 12:49:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:10 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img" returned: 0 in 14.401s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:10 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[075850ef-be76-473a-b043-94dbb7630251]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:10 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:49:10 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:11 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 1.429s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96, size 1024.00 MB, duration 14.40 sec, destination /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:49:11 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Converted 1024.00 MB image at 71.10 MB/s Sep 25 12:49:11 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] 102cee48-f3b7-4718-8b55-57f193947b0c was raw, converting to qcow2 {{(pid=87094) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 12:49:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f66051-9e8a-40ad-a61d-3b10d231c8d1]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:12 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img Sep 25 12:49:12 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:12 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img" returned: 0 in 0.499s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:12 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img Sep 25 12:49:12 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:13 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img" returned: 1 in 0.669s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:13 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2 Sep 25 12:49:13 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:13 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2" returned: 0 in 0.553s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Image conversion details: src /opt/stack/data/cinder/conversion/0a018bb3-23ef-4a5d-8305-34b9424dfd96.temp_image.102cee48-f3b7-4718-8b55-57f193947b0cnrnhcph2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:49:13 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ff0e1-271b-45b0-85a0-72b2b668d943]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:13 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2 Sep 25 12:49:13 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:14 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5j3rhwy2" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.897s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Uploaded volume to glance image-id: 102cee48-f3b7-4718-8b55-57f193947b0c. {{(pid=87094) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.717s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095897449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395b0b70-1d29-442f-a134-cdba855334fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecedd8a9870f41ed98d3f993833de58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:05Z,use_quota=True,user_id='aae96fe04b9246beb28220994ea5f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Creating volume 395b0b70-1d29-442f-a134-cdba855334fc {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:17 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:49:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:17 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc 1073741824 Sep 25 12:49:17 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6eeeb193-8eed-4018-a0f6-92a83f3d50a8 tempest-VolumesActionsTest-610301047 None] Copy volume to image completed successfully. Sep 25 12:49:18 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc 1073741824" returned: 0 in 0.977s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:18 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc Sep 25 12:49:18 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:18 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc" returned: 0 in 0.541s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4eb4a3-6a92-462d-be23-17ed7693cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395b0b70-1d29-442f-a134-cdba855334fc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3e94b-e8ac-4fac-af80-cdeae0bc3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Volume volume-395b0b70-1d29-442f-a134-cdba855334fc (395b0b70-1d29-442f-a134-cdba855334fc): created successfully Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3e94b-e8ac-4fac-af80-cdeae0bc3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Flow 'volume_create_manager' (85e2ff89-0b63-4bde-a8f3-346bc11eb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Acquiring lock "cinder-quobyte-0a018bb3-23ef-4a5d-8305-34b9424dfd96" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7446cc90-6198-471f-93c0-f625dfa761bf tempest-VolumesTransfersV355Test-732493014 None] Created volume successfully. Sep 25 12:49:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "cinder-quobyte-0a018bb3-23ef-4a5d-8305-34b9424dfd96" acquired by "delete_volume" :: waited 0.058s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b897641f-10b9-49c2-9292-355f9a11f735]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:19 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:49:19 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:19 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.583s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:19 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96 Sep 25 12:49:19 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:20 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0a018bb3-23ef-4a5d-8305-34b9424dfd96" returned: 0 in 0.454s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "cinder-quobyte-0a018bb3-23ef-4a5d-8305-34b9424dfd96" released by "delete_volume" :: held 1.133s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Created reservations ['f23952a9-af5a-4b2b-98ba-9e59134fb9eb', '587a0b5c-0c32-4ae9-83f2-e3c28f13cbeb', '7cdcaba5-d09e-4108-9ef9-c1e79fb52bc2', 'fe503d12-dbea-486e-b11f-9b89a72731f2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "cinder-395b0b70-1d29-442f-a134-cdba855334fc-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-395b0b70-1d29-442f-a134-cdba855334fc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "cinder-quobyte-395b0b70-1d29-442f-a134-cdba855334fc" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-quobyte-395b0b70-1d29-442f-a134-cdba855334fc" acquired by "delete_volume" :: waited 0.053s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:20 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:20 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889bf39-528c-4dcc-b6a7-2ade2bdeb92b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:20 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc Sep 25 12:49:20 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:21 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.594s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Deleted volume successfully. Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d6868441-5a22-411d-a27a-79193d69fec8 tempest-VolumesActionsTest-610301047 None] Lock "cinder-0a018bb3-23ef-4a5d-8305-34b9424dfd96-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:21 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc" returned: 0 in 0.689s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:21 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc Sep 25 12:49:21 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:21 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-395b0b70-1d29-442f-a134-cdba855334fc" returned: 0 in 0.430s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-quobyte-395b0b70-1d29-442f-a134-cdba855334fc" released by "delete_volume" :: held 1.242s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Created reservations ['381047e3-78ba-4a05-8313-4b81ced85ec3', '5162b4a8-c898-4f89-9cfa-d0458cac738e', 'ed684158-c1e2-4d4b-94dd-51207c0ae5d0', '1317e80e-bd8b-4283-a9c3-0532ed83a186'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:22 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:22 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:22 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.338s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:22 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Deleted volume successfully. Sep 25 12:49:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-746e20da-9ed8-43ba-bcb0-214819ded768 tempest-VolumesTransfersV355Test-2053110177 None] Lock "cinder-395b0b70-1d29-442f-a134-cdba855334fc-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:31 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=32,cinder:UPDATE=46,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:49:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-1204edd1-dd14-493e-a0fd-452882d0eeb8 req-82a2b6a0-3bfd-4031-b703-da2bff96b740 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-1204edd1-dd14-493e-a0fd-452882d0eeb8 req-82a2b6a0-3bfd-4031-b703-da2bff96b740 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-1204edd1-dd14-493e-a0fd-452882d0eeb8 req-82a2b6a0-3bfd-4031-b703-da2bff96b740 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-1204edd1-dd14-493e-a0fd-452882d0eeb8 req-82a2b6a0-3bfd-4031-b703-da2bff96b740 tempest-TestInstancesWithCinderVolumes-757105088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-58f64266-4b6e-4578-bc69-c764fec389cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33220ab3-e8a0-4aef-8ca7-5183437ff23c', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:49:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-1204edd1-dd14-493e-a0fd-452882d0eeb8 req-82a2b6a0-3bfd-4031-b703-da2bff96b740 tempest-TestInstancesWithCinderVolumes-757105088 None] attachment_update completed successfully. Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Flow 'volume_create_manager' (3bb1f87d-5a61-471e-b387-9cd203ba6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297df420-495d-4f1d-9366-f2fe4a0fca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297df420-495d-4f1d-9366-f2fe4a0fca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-864312911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261827c2-b1bf-4cd1-8122-4c92497886b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772f9cc5f5742d9a057e9073872f429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:35Z,use_quota=True,user_id='31d67d170b604ec787fca9e0dcd96e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707afbfb-d139-413d-8b0a-70cf6b455d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707afbfb-d139-413d-8b0a-70cf6b455d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2223a0-3785-4ed5-a55d-81e88d45b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2223a0-3785-4ed5-a55d-81e88d45b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261827c2-b1bf-4cd1-8122-4c92497886b5', 'volume_name': 'volume-261827c2-b1bf-4cd1-8122-4c92497886b5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c43cb44-2679-443f-b473-7b5ece145e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c43cb44-2679-443f-b473-7b5ece145e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f973c9-0606-4435-b87d-d4d0a8233b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:35 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Volume 261827c2-b1bf-4cd1-8122-4c92497886b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261827c2-b1bf-4cd1-8122-4c92497886b5', 'volume_size': 1} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-864312911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261827c2-b1bf-4cd1-8122-4c92497886b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772f9cc5f5742d9a057e9073872f429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:35Z,use_quota=True,user_id='31d67d170b604ec787fca9e0dcd96e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Creating volume 261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:35 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:49:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:35 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 1073741824 Sep 25 12:49:35 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:36 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 1073741824" returned: 0 in 0.666s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:36 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:36 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:36 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f973c9-0606-4435-b87d-d4d0a8233b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261827c2-b1bf-4cd1-8122-4c92497886b5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2075510-91ab-4b42-a34c-63fca3419916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Volume volume-261827c2-b1bf-4cd1-8122-4c92497886b5 (261827c2-b1bf-4cd1-8122-4c92497886b5): created successfully Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2075510-91ab-4b42-a34c-63fca3419916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Flow 'volume_create_manager' (3bb1f87d-5a61-471e-b387-9cd203ba6be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a24be8a5-5267-481e-9034-d59807499d2f tempest-VolumesCloneTest-1256879153 None] Created volume successfully. Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Flow 'volume_create_manager' (9bfe7ff9-71eb-4eb3-84b2-3ac3b01c95d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0357dad-b491-419b-a17c-864302226366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0357dad-b491-419b-a17c-864302226366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-913097758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9049db-f541-4715-b7bc-0861817797e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633a1ad041d4afbb50b715f75ac7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:38Z,use_quota=True,user_id='4501d7de6bda4d6eaef6bfd5f3633f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fb0d91-7f05-4b3c-a90d-8d9003cf2f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fb0d91-7f05-4b3c-a90d-8d9003cf2f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822e4c68-e308-4013-92a9-5b8886e53ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822e4c68-e308-4013-92a9-5b8886e53ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9049db-f541-4715-b7bc-0861817797e0', 'volume_name': 'volume-1d9049db-f541-4715-b7bc-0861817797e0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc79f2b-3462-49e5-a204-394146744abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc79f2b-3462-49e5-a204-394146744abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3025f9ed-a826-4f3c-bbc6-4bd40b034c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Volume 1d9049db-f541-4715-b7bc-0861817797e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9049db-f541-4715-b7bc-0861817797e0', 'volume_size': 1} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-913097758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9049db-f541-4715-b7bc-0861817797e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633a1ad041d4afbb50b715f75ac7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:38Z,use_quota=True,user_id='4501d7de6bda4d6eaef6bfd5f3633f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Creating volume 1d9049db-f541-4715-b7bc-0861817797e0 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:38 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:38 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 1073741824 Sep 25 12:49:38 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Flow 'volume_create_manager' (1eee9027-73a7-4059-b23a-6e62ada90d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1b3937-56b8-49ea-8dc0-d3a9a83d5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1b3937-56b8-49ea-8dc0-d3a9a83d5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1333849903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe33a967-efb9-4aa9-9a21-45545c4838e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772f9cc5f5742d9a057e9073872f429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=261827c2-b1bf-4cd1-8122-4c92497886b5,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:38Z,use_quota=True,user_id='31d67d170b604ec787fca9e0dcd96e52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be53229-bed5-447c-b254-f51b22e8d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be53229-bed5-447c-b254-f51b22e8d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32819aee-001d-4711-85e8-56dac6501349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32819aee-001d-4711-85e8-56dac6501349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fe33a967-efb9-4aa9-9a21-45545c4838e9', 'volume_name': 'volume-fe33a967-efb9-4aa9-9a21-45545c4838e9', 'volume_size': 2, 'source_volid': '261827c2-b1bf-4cd1-8122-4c92497886b5', 'source_volstatus': 'available'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ce2895-ec1e-4242-84f8-245f29b85b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ce2895-ec1e-4242-84f8-245f29b85b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2936c323-8b1d-46c1-9ef9-bf0163d41adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Volume fe33a967-efb9-4aa9-9a21-45545c4838e9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fe33a967-efb9-4aa9-9a21-45545c4838e9', 'volume_size': 2, 'source_volid': '261827c2-b1bf-4cd1-8122-4c92497886b5', 'source_volstatus': 'available'} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-280ab1ae-87a8-44f9-a360-03d84bda16d9 req-34f6c509-491f-46d7-9ff3-42202427fb43 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:39 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 1073741824" returned: 0 in 0.768s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:39 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 Sep 25 12:49:39 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:39 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0" returned: 0 in 0.294s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.817s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:39 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Cloning volume 261827c2-b1bf-4cd1-8122-4c92497886b5 to volume fe33a967-efb9-4aa9-9a21-45545c4838e9 Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3025f9ed-a826-4f3c-bbc6-4bd40b034c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9049db-f541-4715-b7bc-0861817797e0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9976b88-2967-476b-be74-3161aaa97899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Volume volume-1d9049db-f541-4715-b7bc-0861817797e0 (1d9049db-f541-4715-b7bc-0861817797e0): created successfully Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9976b88-2967-476b-be74-3161aaa97899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Flow 'volume_create_manager' (9bfe7ff9-71eb-4eb3-84b2-3ac3b01c95d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Creating offline snapshot 91adb213-13c7-4bb7-be30-be5b34bc0220 of volume 261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-44e1cf7d-50f8-4a2b-9253-1dfa89c4955e tempest-VolumesTransfersV357Test-2114946296 None] Created volume successfully. Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1d1058-3902-42ec-ab9b-9b0cc772bbc5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:39 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:39 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:40 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:40 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 1G Sep 25 12:49:40 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:41 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 1G" returned: 0 in 0.698s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261827c2-b1bf-4cd1-8122-4c92497886b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:41 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261827c2-b1bf-4cd1-8122-4c92497886b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:41 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:41 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261827c2-b1bf-4cd1-8122-4c92497886b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.457s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:41 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 is being set with open permissions: ugo+rw Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:41 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-aadbfb24-073f-4c44-b2fa-0a512c60b6c3 tempest-VolumesTransfersV357Test-318401409 None] Transfer volume completed successfully. Sep 25 12:49:41 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:41 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:41 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.436s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:42 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info Sep 25 12:49:42 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info" returned: 0 in 0.364s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:42 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info is being set with open permissions: ugo+rw Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:42 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info Sep 25 12:49:42 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "cinder-1d9049db-f541-4715-b7bc-0861817797e0-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-1d9049db-f541-4715-b7bc-0861817797e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "cinder-quobyte-1d9049db-f541-4715-b7bc-0861817797e0" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-quobyte-1d9049db-f541-4715-b7bc-0861817797e0" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f228794-3519-4430-851b-cd5488f23911]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:42 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.info" returned: 0 in 0.394s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] snapshot: 91adb213-13c7-4bb7-be30-be5b34bc0220, volume: fe33a967-efb9-4aa9-9a21-45545c4838e9, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:42 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 Sep 25 12:49:42 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f05dbe-9598-4f0a-b250-e753ebcb71fb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:43 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:43 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0 Sep 25 12:49:43 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:43 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.577s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261827c2-b1bf-4cd1-8122-4c92497886b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d95529d-2b28-4b56-8ba4-e40275857a84]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1d9049db-f541-4715-b7bc-0861817797e0" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-quobyte-1d9049db-f541-4715-b7bc-0861817797e0" released by "delete_volume" :: held 0.974s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:43 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:43 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Created reservations ['50d641ea-5007-485c-9030-f2a3b0e32b7d', '99a5dc39-570f-42ef-9b32-b506b66dc383', '0e76c327-f69b-46d4-8862-2c4f6ae67b1e', '9d270c4c-dfd0-4d58-9389-240742436b4e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:43 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:44 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.695s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:44 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 Sep 25 12:49:44 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:44 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.537s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Deleted volume successfully. Sep 25 12:49:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6668e59-dbb8-4e66-8aca-0ffd699cd5a4 tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-1d9049db-f541-4715-b7bc-0861817797e0-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:45 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Flow 'volume_create_manager' (8a6cb327-f915-44df-9f95-d996bf9b2553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:45 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141d8e8-45d3-4c36-8721-0a0adbef5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2141d8e8-45d3-4c36-8721-0a0adbef5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1078661634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03456ce5-cffe-4133-a94f-9be30af2812b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633a1ad041d4afbb50b715f75ac7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:46Z,use_quota=True,user_id='4501d7de6bda4d6eaef6bfd5f3633f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1421582-edab-427e-9b49-ea0509b03afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1421582-edab-427e-9b49-ea0509b03afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7646a1db-790f-4e68-a57f-2bf66029866f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7646a1db-790f-4e68-a57f-2bf66029866f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03456ce5-cffe-4133-a94f-9be30af2812b', 'volume_name': 'volume-03456ce5-cffe-4133-a94f-9be30af2812b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2e9335-8b7d-417b-9e69-8f301be4d270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2e9335-8b7d-417b-9e69-8f301be4d270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e336d04-2e06-481a-8ed0-0dbfc14dcda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:46 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Volume 03456ce5-cffe-4133-a94f-9be30af2812b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03456ce5-cffe-4133-a94f-9be30af2812b', 'volume_size': 1} Sep 25 12:49:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:47 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:47 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:47 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.448s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:49:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:49:52 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9" returned: 0 in 8.478s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:52 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:49:52 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Converted 1024.00 MB image at 120.76 MB/s Sep 25 12:49:52 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 is being set with open permissions: ugo+rw Sep 25 12:49:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:52 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 Sep 25 12:49:52 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:52 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9" returned: 0 in 0.307s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" released by "_copy_volume_from_snapshot" :: held 10.188s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=62,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-quobyte-91adb213-13c7-4bb7-be30-be5b34bc0220" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-91adb213-13c7-4bb7-be30-be5b34bc0220" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Deleting offline snapshot 91adb213-13c7-4bb7-be30-be5b34bc0220 of volume 261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] snapshot_file for this snap is: volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce74bcd-ee5b-4994-ae57-6a9a41f1c47f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:53 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:53 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:53 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.399s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261827c2-b1bf-4cd1-8122-4c92497886b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a00b7b-e938-425c-bc53-f54f81e62824]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:53 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:53 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:54 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.654s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:54 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:54 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:54 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.552s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:54 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220 Sep 25 12:49:54 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:55 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5.91adb213-13c7-4bb7-be30-be5b34bc0220" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-91adb213-13c7-4bb7-be30-be5b34bc0220" released by "_delete_snapshot" :: held 2.218s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.614s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-280ab1ae-87a8-44f9-a360-03d84bda16d9 req-34f6c509-491f-46d7-9ff3-42202427fb43 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.409s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-280ab1ae-87a8-44f9-a360-03d84bda16d9 req-34f6c509-491f-46d7-9ff3-42202427fb43 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.152s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1078661634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03456ce5-cffe-4133-a94f-9be30af2812b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633a1ad041d4afbb50b715f75ac7303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:46Z,use_quota=True,user_id='4501d7de6bda4d6eaef6bfd5f3633f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Creating volume 03456ce5-cffe-4133-a94f-9be30af2812b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:55 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2936c323-8b1d-46c1-9ef9-bf0163d41adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe33a967-efb9-4aa9-9a21-45545c4838e9', 'volume_size': 2, 'source_volid': '261827c2-b1bf-4cd1-8122-4c92497886b5', 'source_volstatus': 'available'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be511b4b-7382-4a98-93a5-81511b989fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:55 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b 1073741824 Sep 25 12:49:55 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:55 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Volume volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 (fe33a967-efb9-4aa9-9a21-45545c4838e9): created successfully Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be511b4b-7382-4a98-93a5-81511b989fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Flow 'volume_create_manager' (1eee9027-73a7-4059-b23a-6e62ada90d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b6f5f66d-434b-4753-8b4a-aa4150a3bdc3 tempest-VolumesCloneTest-1256879153 None] Created volume successfully. Sep 25 12:49:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-280ab1ae-87a8-44f9-a360-03d84bda16d9 req-34f6c509-491f-46d7-9ff3-42202427fb43 tempest-TestInstancesWithCinderVolumes-757105088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78d7f334-ff93-4cf6-9d04-e49c9dd996a8', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:49:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-280ab1ae-87a8-44f9-a360-03d84bda16d9 req-34f6c509-491f-46d7-9ff3-42202427fb43 tempest-TestInstancesWithCinderVolumes-757105088 None] attachment_update completed successfully. Sep 25 12:49:56 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b 1073741824" returned: 0 in 0.761s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:56 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b Sep 25 12:49:56 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-fe33a967-efb9-4aa9-9a21-45545c4838e9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-fe33a967-efb9-4aa9-9a21-45545c4838e9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" acquired by "delete_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd86144-ff6d-40af-be3d-82344758a4fb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:56 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b" returned: 0 in 0.507s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e336d04-2e06-481a-8ed0-0dbfc14dcda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03456ce5-cffe-4133-a94f-9be30af2812b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c39e775-f156-43cf-87a3-495d982be0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Volume volume-03456ce5-cffe-4133-a94f-9be30af2812b (03456ce5-cffe-4133-a94f-9be30af2812b): created successfully Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c39e775-f156-43cf-87a3-495d982be0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Flow 'volume_create_manager' (8a6cb327-f915-44df-9f95-d996bf9b2553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e899d671-6db1-416f-86fc-adf6eeaecf1e tempest-VolumesTransfersV357Test-2114946296 None] Created volume successfully. Sep 25 12:49:56 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 Sep 25 12:49:56 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9" returned: 0 in 0.571s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:57 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:57 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9 Sep 25 12:49:57 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:57 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fe33a967-efb9-4aa9-9a21-45545c4838e9" returned: 0 in 0.464s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-fe33a967-efb9-4aa9-9a21-45545c4838e9" released by "delete_volume" :: held 1.140s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Created reservations ['1fefb0bb-97da-4d30-b36a-ef81fe0a2aa8', 'f8c80602-dc77-4594-be5c-d857382f6741', 'e0820bbc-5b02-4322-b23d-0f3e34de231c', '4d516c8a-1cea-4428-960c-10dbacd4fdb3'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "cinder-03456ce5-cffe-4133-a94f-9be30af2812b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-03456ce5-cffe-4133-a94f-9be30af2812b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:58 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:58 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "cinder-quobyte-03456ce5-cffe-4133-a94f-9be30af2812b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-quobyte-03456ce5-cffe-4133-a94f-9be30af2812b" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9661a-b4da-4f8a-865f-56efac55dc1a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:58 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b Sep 25 12:49:58 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:58 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.359s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Deleted volume successfully. Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ea724588-862a-49be-8375-83bb98090e75 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-fe33a967-efb9-4aa9-9a21-45545c4838e9-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:58 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b" returned: 0 in 0.652s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:58 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b Sep 25 12:49:58 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-261827c2-b1bf-4cd1-8122-4c92497886b5-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-261827c2-b1bf-4cd1-8122-4c92497886b5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "cinder-quobyte-261827c2-b1bf-4cd1-8122-4c92497886b5" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-261827c2-b1bf-4cd1-8122-4c92497886b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb03ce-869b-41ff-8f53-17e96731450d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:59 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-03456ce5-cffe-4133-a94f-9be30af2812b" returned: 0 in 0.438s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-quobyte-03456ce5-cffe-4133-a94f-9be30af2812b" released by "delete_volume" :: held 1.156s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:59 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:59 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Created reservations ['fc08cfec-870f-47c6-a9d4-4296294238c3', 'ff895686-353e-4652-906d-f6c0e10361c0', '81f100b8-154e-4b7f-b01d-b32df172e078', 'b207531e-084d-40c7-94f0-fec12477f900'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:59 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:49:59 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:59 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.500s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:59 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5 Sep 25 12:49:59 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:59 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.419s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:59 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Deleted volume successfully. Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a5e4a262-4297-4657-8966-f3a456a0e32f tempest-VolumesTransfersV357Test-2022158848 None] Lock "cinder-03456ce5-cffe-4133-a94f-9be30af2812b-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:00 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-261827c2-b1bf-4cd1-8122-4c92497886b5" returned: 0 in 0.432s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-quobyte-261827c2-b1bf-4cd1-8122-4c92497886b5" released by "delete_volume" :: held 1.047s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Created reservations ['90ecbc55-5abe-4584-8cb1-46bb346b582a', '33abe148-ad2d-4a74-bdb3-eeca5329eb6d', '73760060-6891-4075-be0e-f6f0fc950690', '3481c572-2ab8-4856-962e-e09db9f49aaa'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:00 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:00 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:00 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.337s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:00 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Deleted volume successfully. Sep 25 12:50:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1831429a-2181-43f2-8707-67de0acfd7f5 tempest-VolumesCloneTest-1256879153 None] Lock "cinder-261827c2-b1bf-4cd1-8122-4c92497886b5-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-93cc2e40-c944-4653-9279-ff7059f58bfe req-302fc1f2-8501-4a25-ad11-a3115a93a06a tempest-TestInstancesWithCinderVolumes-757105088 None] Terminate volume connection completed successfully. Sep 25 12:50:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-93cc2e40-c944-4653-9279-ff7059f58bfe req-302fc1f2-8501-4a25-ad11-a3115a93a06a tempest-TestInstancesWithCinderVolumes-757105088 None] Deleting attachment 33220ab3-e8a0-4aef-8ca7-5183437ff23c. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:50:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-58f64266-4b6e-4578-bc69-c764fec389cf-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-58f64266-4b6e-4578-bc69-c764fec389cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-quobyte-58f64266-4b6e-4578-bc69-c764fec389cf" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-58f64266-4b6e-4578-bc69-c764fec389cf" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607dc9a-4964-46f1-a25c-4277e115b0c8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:04 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf Sep 25 12:50:04 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:04 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf" returned: 0 in 0.691s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:04 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf Sep 25 12:50:04 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:05 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-58f64266-4b6e-4578-bc69-c764fec389cf" returned: 0 in 0.419s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-58f64266-4b6e-4578-bc69-c764fec389cf" released by "delete_volume" :: held 1.212s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:05 devstack cinder-volume[87094]: WARNING cinder.quota [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294509283-855291236 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294509283-855291236, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:05 devstack cinder-volume[87094]: WARNING cinder.quota [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294509283-855291236 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1294509283-855291236, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Created reservations ['6d5d691f-7fdc-416a-ac86-7f56dbeda653', '35c76c64-ed1b-47b6-be61-f23f1453a478', 'f27fcb21-032d-47e5-8179-0d72b967b864', 'ffe708fe-7918-44af-b069-da24c8192da0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:05 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:05 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:05 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.516s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:05 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Deleted volume successfully. Sep 25 12:50:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fbd81f33-46ef-4081-a8d8-75d566c198cf tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-58f64266-4b6e-4578-bc69-c764fec389cf-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-57cd68b0-3005-49dc-b81f-5c9cd7fa9bb7 req-9a836cdf-594c-4755-bf61-592e56d49b93 tempest-TestInstancesWithCinderVolumes-757105088 None] Terminate volume connection completed successfully. Sep 25 12:50:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-57cd68b0-3005-49dc-b81f-5c9cd7fa9bb7 req-9a836cdf-594c-4755-bf61-592e56d49b93 tempest-TestInstancesWithCinderVolumes-757105088 None] Deleting attachment 78d7f334-ff93-4cf6-9d04-e49c9dd996a8. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:50:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-1a2fb14a-4f16-42f4-8e72-faefccf004b6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-1a2fb14a-4f16-42f4-8e72-faefccf004b6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-quobyte-1a2fb14a-4f16-42f4-8e72-faefccf004b6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-1a2fb14a-4f16-42f4-8e72-faefccf004b6" acquired by "delete_volume" :: waited 0.047s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463db1d-f46a-4ad0-9088-7d53b2168008]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:12 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 Sep 25 12:50:12 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:12 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6" returned: 0 in 0.726s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:12 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6 Sep 25 12:50:12 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Flow 'volume_create_manager' (5e08be97-95a7-454b-abba-48eabaec21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1e86d8-0375-46bb-942e-340d4882cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1e86d8-0375-46bb-942e-340d4882cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1910439442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243e8be0-931f-4a13-846f-6de83f4aaf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eba904191984765a8a0be4e359bfb20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:13Z,use_quota=True,user_id='f222ac9a14a441c98092573005befca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f28882-a547-41d5-b640-9d9560067a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f28882-a547-41d5-b640-9d9560067a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9727895-d367-4c43-b60a-43d734f3ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9727895-d367-4c43-b60a-43d734f3ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243e8be0-931f-4a13-846f-6de83f4aaf4f', 'volume_name': 'volume-243e8be0-931f-4a13-846f-6de83f4aaf4f', 'volume_size': 2}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425d375e-bb6a-49d0-bf9f-e4516b1bf18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425d375e-bb6a-49d0-bf9f-e4516b1bf18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb6a76-5cb4-49e9-b432-af8a154ee8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Volume 243e8be0-931f-4a13-846f-6de83f4aaf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243e8be0-931f-4a13-846f-6de83f4aaf4f', 'volume_size': 2} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1910439442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243e8be0-931f-4a13-846f-6de83f4aaf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eba904191984765a8a0be4e359bfb20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:13Z,use_quota=True,user_id='f222ac9a14a441c98092573005befca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Creating volume 243e8be0-931f-4a13-846f-6de83f4aaf4f {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:13 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f 2147483648 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:13 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a2fb14a-4f16-42f4-8e72-faefccf004b6" returned: 0 in 0.523s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:13 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f 2147483648 Sep 25 12:50:13 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-1a2fb14a-4f16-42f4-8e72-faefccf004b6" released by "delete_volume" :: held 1.381s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:13 devstack cinder-volume[87094]: WARNING cinder.quota [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-510943029-15870954 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-510943029-15870954, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:13 devstack cinder-volume[87094]: WARNING cinder.quota [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-510943029-15870954 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-510943029-15870954, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Created reservations ['562a985f-8036-46e4-ba50-f74aae24978e', 'b2da30a0-ad76-404f-affe-103bd79cae7b', 'e97dc4f2-b254-4743-8e3d-bd90e9d14aa5', '2b6a34c0-262e-46d8-8930-382bd0017c3d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:13 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:13 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:14 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.572s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Deleted volume successfully. Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e705cf6f-e20a-4834-bb21-0371b925f681 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-1a2fb14a-4f16-42f4-8e72-faefccf004b6-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:14 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f 2147483648" returned: 0 in 1.009s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:14 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f Sep 25 12:50:14 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:14 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f" returned: 0 in 0.463s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfb6a76-5cb4-49e9-b432-af8a154ee8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243e8be0-931f-4a13-846f-6de83f4aaf4f', 'volume_size': 2}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae88d626-f75b-457c-8e25-1f6c64de544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Volume volume-243e8be0-931f-4a13-846f-6de83f4aaf4f (243e8be0-931f-4a13-846f-6de83f4aaf4f): created successfully Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae88d626-f75b-457c-8e25-1f6c64de544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Flow 'volume_create_manager' (5e08be97-95a7-454b-abba-48eabaec21ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-90dd7598-1c0b-45ea-816d-60b8560d938b tempest-VolumesCloneNegativeTest-1423434527 None] Created volume successfully. Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Acquiring lock "cinder-243e8be0-931f-4a13-846f-6de83f4aaf4f-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Flow 'volume_create_manager' (3b4061a8-fd56-45be-8603-b29070582fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3deee235-d754-486f-9879-71626b659b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "cinder-243e8be0-931f-4a13-846f-6de83f4aaf4f-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3deee235-d754-486f-9879-71626b659b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1968597441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9891e91b-b4f5-4923-9dfd-35dfe40d1884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da190ab53ec1483dbdef8ad57358b845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:15Z,use_quota=True,user_id='f2f21aa909ed447f823ad00f289c6d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a004f7d-5540-4b52-8fa3-331c4f66a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a004f7d-5540-4b52-8fa3-331c4f66a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e225620-8011-4507-b2fc-92f717c4445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e225620-8011-4507-b2fc-92f717c4445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9891e91b-b4f5-4923-9dfd-35dfe40d1884', 'volume_name': 'volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63022bcf-3f86-40af-a9a9-95df775ee080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63022bcf-3f86-40af-a9a9-95df775ee080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eaae95-c9a2-400b-ad64-411389b98a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume 9891e91b-b4f5-4923-9dfd-35dfe40d1884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884', 'volume_size': 1} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1968597441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9891e91b-b4f5-4923-9dfd-35dfe40d1884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da190ab53ec1483dbdef8ad57358b845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:15Z,use_quota=True,user_id='f2f21aa909ed447f823ad00f289c6d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Creating volume 9891e91b-b4f5-4923-9dfd-35dfe40d1884 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:15 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 1073741824 Sep 25 12:50:15 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Acquiring lock "cinder-quobyte-243e8be0-931f-4a13-846f-6de83f4aaf4f" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "cinder-quobyte-243e8be0-931f-4a13-846f-6de83f4aaf4f" acquired by "delete_volume" :: waited 0.078s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7f53c2-58bf-4f9e-9c71-349c5c6a6f00]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:16 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f Sep 25 12:50:16 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Flow 'volume_create_manager' (443363fe-1efa-403b-8546-e97d07b477ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ef6b1-5ea1-40ef-b364-647da55cde39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8ef6b1-5ea1-40ef-b364-647da55cde39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1877590637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1224e8f-2757-4eef-ad26-291edd568720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da190ab53ec1483dbdef8ad57358b845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:16Z,use_quota=True,user_id='f2f21aa909ed447f823ad00f289c6d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c889d25-1bd1-4a2d-a054-84c74870deb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c889d25-1bd1-4a2d-a054-84c74870deb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc719575-e8f2-4e1d-8362-79232b37050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc719575-e8f2-4e1d-8362-79232b37050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1224e8f-2757-4eef-ad26-291edd568720', 'volume_name': 'volume-c1224e8f-2757-4eef-ad26-291edd568720', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10218190-402a-41f9-b435-60556465723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10218190-402a-41f9-b435-60556465723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8777d10d-3e96-4bea-9aa5-7cddca5ddbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume c1224e8f-2757-4eef-ad26-291edd568720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1224e8f-2757-4eef-ad26-291edd568720', 'volume_size': 1} Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:16 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 1073741824" returned: 0 in 1.198s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f" returned: 0 in 1.044s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 Sep 25 12:50:17 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:17 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f Sep 25 12:50:17 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:17 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-243e8be0-931f-4a13-846f-6de83f4aaf4f" returned: 0 in 0.417s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "cinder-quobyte-243e8be0-931f-4a13-846f-6de83f4aaf4f" released by "delete_volume" :: held 1.610s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Created reservations ['6546ccc7-368e-471b-9fcf-264cab42a9b8', '131717a0-9753-4515-a0f8-bbebc12bcea2', '0418b9dd-6f02-429e-b558-43c2b80414e4', 'b448feff-ee91-434b-889a-f391b54a5c33'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:17 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884" returned: 0 in 0.763s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1877590637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1224e8f-2757-4eef-ad26-291edd568720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da190ab53ec1483dbdef8ad57358b845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:16Z,use_quota=True,user_id='f2f21aa909ed447f823ad00f289c6d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Creating volume c1224e8f-2757-4eef-ad26-291edd568720 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:17 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 1073741824 Sep 25 12:50:17 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eaae95-c9a2-400b-ad64-411389b98a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedacc14-bd6b-44c0-a436-042673921bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 (9891e91b-b4f5-4923-9dfd-35dfe40d1884): created successfully Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedacc14-bd6b-44c0-a436-042673921bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Flow 'volume_create_manager' (3b4061a8-fd56-45be-8603-b29070582fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9368cbbd-2ccb-412e-80b9-71d8cda40692 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Created volume successfully. Sep 25 12:50:18 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:18 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Flow 'volume_create_manager' (d5d8a414-7237-4d76-804b-8cd6fe030855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ce03d1-8cd8-4df7-9907-06527475781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ce03d1-8cd8-4df7-9907-06527475781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-440684551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ea01b9-ac55-4928-984d-b292ffba4de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7a7ecea5ac4d07a8d41e62845ffd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:18Z,use_quota=True,user_id='2b3f926eee894ca58014137f26abaac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa196781-e294-47b9-b2b2-c64001f88da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa196781-e294-47b9-b2b2-c64001f88da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6129c3da-cf46-46a6-becb-e42eac63f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:18 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:50:19 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 1073741824" returned: 0 in 1.334s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:19 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 1.091s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:19 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 Sep 25 12:50:19 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Deleted volume successfully. Sep 25 12:50:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4d3920f6-0528-4aad-95a7-9713cfcb7006 tempest-VolumesCloneNegativeTest-1423434527 None] Lock "cinder-243e8be0-931f-4a13-846f-6de83f4aaf4f-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:20 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720" returned: 0 in 0.890s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8777d10d-3e96-4bea-9aa5-7cddca5ddbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1224e8f-2757-4eef-ad26-291edd568720', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9949fc14-cd46-4b10-ad6b-e5b3db9bc2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Volume volume-c1224e8f-2757-4eef-ad26-291edd568720 (c1224e8f-2757-4eef-ad26-291edd568720): created successfully Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9949fc14-cd46-4b10-ad6b-e5b3db9bc2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Flow 'volume_create_manager' (443363fe-1efa-403b-8546-e97d07b477ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3276a3fc-8d8d-4a0f-99e6-4b09126076f0 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Created volume successfully. Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6129c3da-cf46-46a6-becb-e42eac63f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87ea01b9-ac55-4928-984d-b292ffba4de6', 'volume_name': 'volume-87ea01b9-ac55-4928-984d-b292ffba4de6', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f3396f-94ad-44e0-be1c-055e35910b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f3396f-94ad-44e0-be1c-055e35910b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6a538-eaa0-4c45-8406-54e96aa36bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Volume 87ea01b9-ac55-4928-984d-b292ffba4de6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87ea01b9-ac55-4928-984d-b292ffba4de6', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:50:20 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Trying to clone 87ea01b9-ac55-4928-984d-b292ffba4de6 from image d090291b-21f1-4593-a719-dd6e6ea3f284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:50:21 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:50:21 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:50:21 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c94c7-1ab9-47b2-b356-1ca966bec338]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:21 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD Sep 25 12:50:21 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:22 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 is fetched for user 2b3f926eee894ca58014137f26abaac5. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d335d7c-31f9-4f91-9b65-0c8cd24ac6bc]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:22 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD Sep 25 12:50:22 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:22 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-440684551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ea01b9-ac55-4928-984d-b292ffba4de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7a7ecea5ac4d07a8d41e62845ffd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:18Z,use_quota=True,user_id='2b3f926eee894ca58014137f26abaac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Creating volume 87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:22 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:22 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1073741824 Sep 25 12:50:22 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-65225d99-2525-4cb3-9725-f7586e1d3ff1 req-c9849b75-0f7f-4892-bf8b-8ee55e1aae84 tempest-TestInstancesWithCinderVolumes-757105088 None] Terminate volume connection completed successfully. Sep 25 12:50:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-65225d99-2525-4cb3-9725-f7586e1d3ff1 req-c9849b75-0f7f-4892-bf8b-8ee55e1aae84 tempest-TestInstancesWithCinderVolumes-757105088 None] Deleting attachment cb5ec664-c73c-4e01-b018-7f051fe2e8b9. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:50:23 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1073741824" returned: 0 in 0.928s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:23 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 Sep 25 12:50:23 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:24 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6" returned: 0 in 0.590s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Attempting download of d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 87ea01b9-ac55-4928-984d-b292ffba4de6. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d6ef4-1cfa-46a3-83f4-4eb32a0dfe81]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-9f157930-e78d-401d-8db1-ea553aadb8de-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-9f157930-e78d-401d-8db1-ea553aadb8de-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:24 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf Sep 25 12:50:24 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "cinder-quobyte-9f157930-e78d-401d-8db1-ea553aadb8de" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-9f157930-e78d-401d-8db1-ea553aadb8de" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95836dc-0e27-441a-bb14-9abc32062925]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:25 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de Sep 25 12:50:25 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:25 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf" returned: 0 in 0.701s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:25 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf Sep 25 12:50:25 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:25 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de" returned: 0 in 0.804s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:25 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de Sep 25 12:50:25 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:25 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf" returned: 1 in 0.563s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_sqxghgyf' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77640d-061b-4283-9350-93cbdf870395]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:25 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD Sep 25 12:50:25 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:26 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f157930-e78d-401d-8db1-ea553aadb8de" returned: 0 in 0.483s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-quobyte-9f157930-e78d-401d-8db1-ea553aadb8de" released by "delete_volume" :: held 1.403s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:26 devstack cinder-volume[87094]: WARNING cinder.quota [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407116053-1518756341 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407116053-1518756341, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:26 devstack cinder-volume[87094]: WARNING cinder.quota [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407116053-1518756341 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407116053-1518756341, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Created reservations ['6d37721d-b72d-42b2-935f-0f021a8f65fa', 'ab8d85fa-ae09-432c-8f55-5b4409a09b6f', '8aba0d35-c715-4fdf-abf6-8dbfa26d8a13', '1fd6a4c7-107e-4560-8774-addce8aae818'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:26 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] d090291b-21f1-4593-a719-dd6e6ea3f284 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:26 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:26 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:26 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 Sep 25 12:50:26 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:26 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Deleted volume successfully. Sep 25 12:50:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-02325638-caf3-4847-b27d-44818b6ee635 tempest-TestInstancesWithCinderVolumes-757105088 None] Lock "cinder-9f157930-e78d-401d-8db1-ea553aadb8de-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (545e2ea0-164e-43c2-9bc3-ae52e40c648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9defb3d2-bc24-433f-8d01-84cd7179896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9defb3d2-bc24-433f-8d01-84cd7179896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1581125973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c71bab-0ae1-4351-80b3-0ed2c2066fae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:29Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50189336-77e4-41c9-be80-492f85584f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50189336-77e4-41c9-be80-492f85584f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a30c220-1734-4a5f-9814-aa2b2bd90dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a30c220-1734-4a5f-9814-aa2b2bd90dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c71bab-0ae1-4351-80b3-0ed2c2066fae', 'volume_name': 'volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e5da36-2131-48fb-90ef-41d2bb049fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e5da36-2131-48fb-90ef-41d2bb049fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d9c38-f5fe-4458-a07e-8681b57d02aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Volume c1c71bab-0ae1-4351-80b3-0ed2c2066fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae', 'volume_size': 1} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1581125973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c71bab-0ae1-4351-80b3-0ed2c2066fae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:29Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Creating volume c1c71bab-0ae1-4351-80b3-0ed2c2066fae {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:28 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:28 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae 1073741824 Sep 25 12:50:28 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:29 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae 1073741824" returned: 0 in 0.855s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:29 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae Sep 25 12:50:29 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:30 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6" returned: 0 in 3.658s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_cspis3wwdevstack@QuobyteHD, size 112.00 MB, duration 3.66 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:50:30 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Converted 112.00 MB image at 30.56 MB/s Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:30 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1G Sep 25 12:50:30 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:30 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d9c38-f5fe-4458-a07e-8681b57d02aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e11904-4867-4773-88a1-e73a336ac2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Volume volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae (c1c71bab-0ae1-4351-80b3-0ed2c2066fae): created successfully Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e11904-4867-4773-88a1-e73a336ac2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (545e2ea0-164e-43c2-9bc3-ae52e40c648d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-de6e6419-9c8b-4ef8-918d-0d8257a9fddd tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:50:30 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 1G" returned: 0 in 0.471s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Downloaded image d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 87ea01b9-ac55-4928-984d-b292ffba4de6 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 for user 2b3f926eee894ca58014137f26abaac5 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Marking volume 87ea01b9-ac55-4928-984d-b292ffba4de6 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Copying metadata from image d090291b-21f1-4593-a719-dd6e6ea3f284 to 87ea01b9-ac55-4928-984d-b292ffba4de6. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Creating volume glance metadata for volume 87ea01b9-ac55-4928-984d-b292ffba4de6 backed by image d090291b-21f1-4593-a719-dd6e6ea3f284 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6a538-eaa0-4c45-8406-54e96aa36bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ea01b9-ac55-4928-984d-b292ffba4de6', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad19c54-bf81-4f24-8770-e5b78d77b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Volume volume-87ea01b9-ac55-4928-984d-b292ffba4de6 (87ea01b9-ac55-4928-984d-b292ffba4de6): created successfully Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad19c54-bf81-4f24-8770-e5b78d77b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Flow 'volume_create_manager' (d5d8a414-7237-4d76-804b-8cd6fe030855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f1feb4dc-e73e-415e-8a15-f4e588f977a7 tempest-VolumesExtendTest-1868881522 None] Created volume successfully. Sep 25 12:50:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:31 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f02513-9636-4526-a4c9-6f21359c16ac]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:31 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 Sep 25 12:50:31 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=92,cinder:UPDATE=95,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (353b51e8-6b25-4974-8f32-425581a750b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ab70a-baca-445e-bc4d-28bfe9029c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ab70a-baca-445e-bc4d-28bfe9029c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1637104034',display_name='tempest-VolumesGetTest-Volume-286687969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daeb8e2-ceaa-4898-99af-c015285bf2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:32Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7930cfd-8613-4b26-954e-63e6f519ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7930cfd-8613-4b26-954e-63e6f519ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82022836-6026-4de5-9601-5a58a54c77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82022836-6026-4de5-9601-5a58a54c77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daeb8e2-ceaa-4898-99af-c015285bf2dd', 'volume_name': 'volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd9f2cf-6a65-4255-ac15-0164eeacc1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd9f2cf-6a65-4255-ac15-0164eeacc1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86808ee-896f-4765-93a6-b03355e9f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Volume 5daeb8e2-ceaa-4898-99af-c015285bf2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd', 'volume_size': 1} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6" returned: 0 in 1.019s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 2G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 2G" returned: 0 in 0.251s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.347s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1637104034',display_name='tempest-VolumesGetTest-Volume-286687969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daeb8e2-ceaa-4898-99af-c015285bf2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:32Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Creating volume 5daeb8e2-ceaa-4898-99af-c015285bf2dd {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:32 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:32 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd 1073741824 Sep 25 12:50:32 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e451fa0f-97ff-42a4-af80-e424a8e7f8dc tempest-VolumesExtendTest-1868881522 None] Extend volume completed successfully. Sep 25 12:50:33 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd 1073741824" returned: 0 in 1.242s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:34 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd Sep 25 12:50:34 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-87ea01b9-ac55-4928-984d-b292ffba4de6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "cinder-87ea01b9-ac55-4928-984d-b292ffba4de6-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:34 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd" returned: 0 in 0.662s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86808ee-896f-4765-93a6-b03355e9f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc062da-a857-46a5-8d60-51221a6d5f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-quobyte-87ea01b9-ac55-4928-984d-b292ffba4de6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Volume volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd (5daeb8e2-ceaa-4898-99af-c015285bf2dd): created successfully Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc062da-a857-46a5-8d60-51221a6d5f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (353b51e8-6b25-4974-8f32-425581a750b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-87ea01b9-ac55-4928-984d-b292ffba4de6" acquired by "delete_volume" :: waited 0.066s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecf1a6f-e515-460c-a2ae-b7a034ee7d57]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-41e47703-40b2-4700-9764-7fde8d0fc0a5 tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:50:35 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 Sep 25 12:50:35 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:35 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6" returned: 0 in 0.782s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:35 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6 Sep 25 12:50:35 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-5daeb8e2-ceaa-4898-99af-c015285bf2dd-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "cinder-5daeb8e2-ceaa-4898-99af-c015285bf2dd-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-5daeb8e2-ceaa-4898-99af-c015285bf2dd" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-5daeb8e2-ceaa-4898-99af-c015285bf2dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4997a-ee98-4aea-833d-1ffb8aac0031]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:36 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd Sep 25 12:50:36 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:36 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-87ea01b9-ac55-4928-984d-b292ffba4de6" returned: 0 in 0.753s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-87ea01b9-ac55-4928-984d-b292ffba4de6" released by "delete_volume" :: held 1.679s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:36 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Created reservations ['54894417-41d1-482d-8e52-9693e9f596db', 'c03d06b6-cf55-4876-b5aa-ee7670ab3fd7', '2ab8605b-a866-4740-bfe1-ba393a803701', '51900219-1cd1-4767-ae2e-51c5d3dab241'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:37 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd" returned: 0 in 1.119s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:37 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:37 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:37 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd Sep 25 12:50:37 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:38 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.745s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Deleted volume successfully. Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9f0e08a4-263f-494a-9520-294241cbbec2 tempest-VolumesExtendTest-1868881522 None] Lock "cinder-87ea01b9-ac55-4928-984d-b292ffba4de6-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:38 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5daeb8e2-ceaa-4898-99af-c015285bf2dd" returned: 0 in 1.039s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-5daeb8e2-ceaa-4898-99af-c015285bf2dd" released by "delete_volume" :: held 2.300s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Created reservations ['0b9df3df-4649-447c-86d8-514aefea1aaf', '80e09683-a237-4e9b-bccd-36e32e01c8bb', '614c562b-2d07-41ee-8631-6b5b968caaf4', '42b4d5de-6bb3-424c-9a75-10532f4068df'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:39 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:39 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Flow 'volume_create_manager' (505b4294-0f6b-46e5-b525-e7aa07a699c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5357b9e-3d50-49c1-bfe2-6db929e52fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5357b9e-3d50-49c1-bfe2-6db929e52fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1376435884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370a8085-0042-4557-af65-5880baa1d1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7a7ecea5ac4d07a8d41e62845ffd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:39Z,use_quota=True,user_id='2b3f926eee894ca58014137f26abaac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b446726-089d-4147-8c04-c4f878ef6b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b446726-089d-4147-8c04-c4f878ef6b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a695ab8-f984-43ea-8022-0fae8f8d4ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a695ab8-f984-43ea-8022-0fae8f8d4ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370a8085-0042-4557-af65-5880baa1d1eb', 'volume_name': 'volume-370a8085-0042-4557-af65-5880baa1d1eb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6158bb38-0b7c-4103-9943-2cc908b75047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6158bb38-0b7c-4103-9943-2cc908b75047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a175e7b-665d-4906-85fc-552c308082ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Volume 370a8085-0042-4557-af65-5880baa1d1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370a8085-0042-4557-af65-5880baa1d1eb', 'volume_size': 1} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1376435884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370a8085-0042-4557-af65-5880baa1d1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7a7ecea5ac4d07a8d41e62845ffd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:39Z,use_quota=True,user_id='2b3f926eee894ca58014137f26abaac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Creating volume 370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:39 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:39 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb 1073741824 Sep 25 12:50:39 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:39 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.640s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:50:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-238480cc-f315-4476-8ce8-59376fc28c08 tempest-VolumesGetTest-592094836 None] Lock "cinder-5daeb8e2-ceaa-4898-99af-c015285bf2dd-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-c1c71bab-0ae1-4351-80b3-0ed2c2066fae-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "cinder-c1c71bab-0ae1-4351-80b3-0ed2c2066fae-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" acquired by "delete_volume" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee65447-e6ad-4226-a3de-04cd3e133a7e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:40 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb 1073741824" returned: 0 in 1.275s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:40 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:40 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:40 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae Sep 25 12:50:40 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:41 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" returned: 0 in 0.876s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:41 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 0.808s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:41 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae Sep 25 12:50:41 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a175e7b-665d-4906-85fc-552c308082ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370a8085-0042-4557-af65-5880baa1d1eb', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef6eb7-ea8c-48d8-9141-1b4aa1b3e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:41 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Volume volume-370a8085-0042-4557-af65-5880baa1d1eb (370a8085-0042-4557-af65-5880baa1d1eb): created successfully Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef6eb7-ea8c-48d8-9141-1b4aa1b3e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Flow 'volume_create_manager' (505b4294-0f6b-46e5-b525-e7aa07a699c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:41 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-85b71d17-1319-4095-bb69-7bb7f37e238e tempest-VolumesExtendTest-1868881522 None] Created volume successfully. Sep 25 12:50:42 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" returned: 0 in 0.689s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-c1c71bab-0ae1-4351-80b3-0ed2c2066fae" released by "delete_volume" :: held 1.689s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Created reservations ['81244f2c-f02b-4f0e-ae22-130d2577ab37', '40cead2e-e486-4954-856f-6833b8df7d09', 'ca677fe9-6218-40db-9ec4-bc2514422f8e', '5ee89e89-a029-4108-a8ea-753acf8ba4b9'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:42 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:42 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:43 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.716s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3d38f896-4d39-48c0-84a2-58aa6d129051 tempest-VolumesGetTest-592094836 None] Lock "cinder-c1c71bab-0ae1-4351-80b3-0ed2c2066fae-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Creating offline snapshot 4ac2e2bb-f9e5-42d7-8792-949753066105 of volume 370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b51946-45a8-496f-a424-e484bcc33c53]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:43 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:43 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:44 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 1.093s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:44 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 1G Sep 25 12:50:44 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (14974ef4-4ac5-41a7-979d-78e9b77dd1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653a6e47-9d5b-40eb-afec-07220f30241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653a6e47-9d5b-40eb-afec-07220f30241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-325552672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b1de3e-ad0b-443b-ab72-f83245b72ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:45Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a2e11c-cec8-40f5-98d1-ceb5ea07a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a2e11c-cec8-40f5-98d1-ceb5ea07a03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c885472-0797-4789-85b8-5370a41e3552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c885472-0797-4789-85b8-5370a41e3552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'volume_name': 'volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdd94a-027c-4f9d-86b1-e56958722ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdd94a-027c-4f9d-86b1-e56958722ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1b4a9-3154-4b22-90b7-9eda2d628ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Volume c0b1de3e-ad0b-443b-ab72-f83245b72ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'volume_size': 1} Sep 25 12:50:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:45 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 1G" returned: 0 in 0.863s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-370a8085-0042-4557-af65-5880baa1d1eb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:45 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-370a8085-0042-4557-af65-5880baa1d1eb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 Sep 25 12:50:45 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:46 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-370a8085-0042-4557-af65-5880baa1d1eb -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:46 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 is being set with open permissions: ugo+rw Sep 25 12:50:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:46 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 Sep 25 12:50:46 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:46 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105" returned: 0 in 0.397s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:46 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info Sep 25 12:50:46 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:47 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info" returned: 0 in 0.540s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:47 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info is being set with open permissions: ugo+rw Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:47 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info Sep 25 12:50:47 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:47 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:47 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:47 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.info" returned: 0 in 0.434s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.927s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-325552672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b1de3e-ad0b-443b-ab72-f83245b72ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:45Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Creating volume c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:47 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:47 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:47 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 1073741824 Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.355s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:47 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d4945be8-d292-4daa-9dad-0a76ce38538c tempest-VolumesExtendTest-1868881522 None] Create snapshot completed successfully Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:50:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:48 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 1073741824" returned: 0 in 0.935s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:48 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:50:48 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:48 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.345s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.780s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb1b4a9-3154-4b22-90b7-9eda2d628ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92742f9-8939-4ad2-87dc-7a07059af1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486cc44-84b4-4a28-8fda-1ecda6f7d63a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:48 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Volume volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 (c0b1de3e-ad0b-443b-ab72-f83245b72ad6): created successfully Sep 25 12:50:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92742f9-8939-4ad2-87dc-7a07059af1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (14974ef4-4ac5-41a7-979d-78e9b77dd1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a77641d3-ad7b-401b-83d1-11c67581817c tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:50:49 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:49 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:49 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 0.594s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 2G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 2G" returned: 0 in 0.188s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.893s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-98251707-d15b-47ca-aa94-abe13eb35e7f tempest-VolumesExtendTest-1868881522 None] Extend volume completed successfully. Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-4ac2e2bb-f9e5-42d7-8792-949753066105-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-4ac2e2bb-f9e5-42d7-8792-949753066105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-quobyte-4ac2e2bb-f9e5-42d7-8792-949753066105" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-4ac2e2bb-f9e5-42d7-8792-949753066105" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Deleting offline snapshot 4ac2e2bb-f9e5-42d7-8792-949753066105 of volume 370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] snapshot_file for this snap is: volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d915709-4a0a-4da5-8ce0-c21a88000776]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:51 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 Sep 25 12:50:51 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:51 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105" returned: 0 in 0.625s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-370a8085-0042-4557-af65-5880baa1d1eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6e8cc-c449-4734-9d57-d14807294266]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (d124bbca-2874-4782-acee-76c6ad5bf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5a65a-162a-4379-9a63-885ec82b1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d5a65a-162a-4379-9a63-885ec82b1a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1012119174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8fe848-363f-44d2-8162-e11ccd0fa0ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c0b1de3e-ad0b-443b-ab72-f83245b72ad6,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:51Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e47ec-03e1-4e72-b38a-99828d34827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e47ec-03e1-4e72-b38a-99828d34827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69379bc4-5bb2-42c4-8b77-b7ecf70cfbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69379bc4-5bb2-42c4-8b77-b7ecf70cfbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc8fe848-363f-44d2-8162-e11ccd0fa0ab', 'volume_name': 'volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab', 'volume_size': 1, 'source_volid': 'c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'source_volstatus': 'available'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d194bd1f-d67a-4b12-9cd7-7c100aa2187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d194bd1f-d67a-4b12-9cd7-7c100aa2187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e4357-dd6a-4330-b6ff-8bde83a12ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Volume fc8fe848-363f-44d2-8162-e11ccd0fa0ab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab', 'volume_size': 1, 'source_volid': 'c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'source_volstatus': 'available'} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:51 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Cloning volume c0b1de3e-ad0b-443b-ab72-f83245b72ad6 to volume fc8fe848-363f-44d2-8162-e11ccd0fa0ab Sep 25 12:50:51 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:51 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Creating offline snapshot a290d778-2daf-4031-99e5-2ae2fd51e841 of volume c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80fe65-cb81-4660-a6f0-3a7ae50c4bda]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:52 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:50:52 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:52 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 0.943s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:52 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 Sep 25 12:50:52 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:52 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.787s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:52 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 1G Sep 25 12:50:52 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:53 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105" returned: 0 in 0.672s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:53 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105 Sep 25 12:50:53 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:53 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 1G" returned: 0 in 0.760s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:53 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:50:53 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:53 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb.4ac2e2bb-f9e5-42d7-8792-949753066105" returned: 0 in 0.407s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=120,cinder:SELECT=96,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-4ac2e2bb-f9e5-42d7-8792-949753066105" released by "_delete_snapshot" :: held 2.891s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" released by "delete_snapshot" :: held 2.963s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Created reservations ['4f2feb83-8847-4b85-bee9-2d104d1af240', '8caba4b4-a0d4-4821-8311-21e080b6a9fb', '17f01aaf-ed55-4e49-9de2-d5eebb2bcd3a', 'eeefb70e-3bf1-4f5d-b72d-ac7a9ae7166c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:53 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:53 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 is being set with open permissions: ugo+rw Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Delete snapshot completed successfully. Sep 25 12:50:53 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:50:53 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9bce70a6-d166-4586-85c5-7458f116e8bc tempest-VolumesExtendTest-1868881522 None] Lock "cinder-4ac2e2bb-f9e5-42d7-8792-949753066105-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-370a8085-0042-4557-af65-5880baa1d1eb-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "cinder-370a8085-0042-4557-af65-5880baa1d1eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Acquiring lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b49f5-9403-43ba-b7c8-1597c83b8406]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:54 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:54 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info Sep 25 12:50:54 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:54 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:54 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:54 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info" returned: 0 in 0.425s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:54 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info is being set with open permissions: ugo+rw Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:54 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 0.521s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:54 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info Sep 25 12:50:54 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:54 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb Sep 25 12:50:54 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:55 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.info" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:55 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-370a8085-0042-4557-af65-5880baa1d1eb" returned: 0 in 0.382s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "cinder-quobyte-370a8085-0042-4557-af65-5880baa1d1eb" released by "delete_volume" :: held 1.011s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] snapshot: a290d778-2daf-4031-99e5-2ae2fd51e841, volume: fc8fe848-363f-44d2-8162-e11ccd0fa0ab, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c69628-d48b-4a69-8980-e3e96cc5b26e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Created reservations ['9b64cdff-8efc-4363-8dc8-8c287a7a501d', '17d6da0a-da54-42b9-a9b9-788c1ec21fe8', 'a9ab90fc-a6a5-4d0d-96ec-ef327efc0e21', '27249f6d-0266-4950-8923-c71b033adb15'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:55 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:50:55 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:55 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:50:55 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:55 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d78bb9-c2a8-4e5f-bc10-0c9fd7b3c2f0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:55 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Deleted volume successfully. Sep 25 12:50:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-58e1ae39-aa7c-41a2-ac38-1f849460068f tempest-VolumesExtendTest-1868881522 None] Lock "cinder-370a8085-0042-4557-af65-5880baa1d1eb-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:56 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:50:56 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:56 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.485s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:50:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:50:56 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:50:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:56 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab Sep 25 12:50:56 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:05 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=38,cinder:UPDATE=51,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:05 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Flow 'volume_create_manager' (594d13ca-1bc3-4dce-8b24-4ab69659646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a22dff2-d604-4e15-a0d8-f0c769df4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a22dff2-d604-4e15-a0d8-f0c769df4209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e87fbb8-34eb-4340-965c-c2f2e37e379e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8d61e264c4597ab74d7d7a4cfa31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:07Z,use_quota=True,user_id='1102d124999b46ba80da657d9ef2bc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666cc9ca-ba08-42ff-ab73-157bdb688e58),volume_type_id=666cc9ca-ba08-42ff-ab73-157bdb688e58)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1097a6-e6b3-46fa-82e8-63a5f498dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1097a6-e6b3-46fa-82e8-63a5f498dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eef695-48fc-49c3-a191-20da74efa825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:06 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:51:07 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" returned: 0 in 11.334s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6, size 1024.00 MB, duration 11.34 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:51:07 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Converted 1024.00 MB image at 90.33 MB/s Sep 25 12:51:07 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab is being set with open permissions: ugo+rw Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:07 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab Sep 25 12:51:07 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-90cb5372-5da0-402b-87ec-6b623fa252cf req-cf3ec68e-99d5-45b2-a3aa-14682d4a9d68 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eef695-48fc-49c3-a191-20da74efa825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e87fbb8-34eb-4340-965c-c2f2e37e379e', 'volume_name': 'volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e', 'volume_size': 1, 'image_id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b409a270d0e286eca5c70f1235f8243c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff8d61e264c4597ab74d7d7a4cfa31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f48748bd84e6adf997b786c330859e54f58c3816e3adc559d27cc2209cf78a3dcfa5245f7ffd0186c11e7c2349cd3fd3c4556898b2131eb02d324b1ec23a50', 'id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'created_at': datetime.datetime(2026, 9, 25, 10, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7618c6f6-99fe-4aa9-b945-d206d587b927/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429cc8a8-b5c7-4c8e-aa5b-94bae7cb7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429cc8a8-b5c7-4c8e-aa5b-94bae7cb7db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5c10c-e52f-4b81-8eef-5b502c430974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e', 'volume_size': 1, 'image_id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b409a270d0e286eca5c70f1235f8243c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff8d61e264c4597ab74d7d7a4cfa31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f48748bd84e6adf997b786c330859e54f58c3816e3adc559d27cc2209cf78a3dcfa5245f7ffd0186c11e7c2349cd3fd3c4556898b2131eb02d324b1ec23a50', 'id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'created_at': datetime.datetime(2026, 9, 25, 10, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7618c6f6-99fe-4aa9-b945-d206d587b927/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 12:51:07 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Trying to clone 9e87fbb8-34eb-4340-965c-c2f2e37e379e from image 7618c6f6-99fe-4aa9-b945-d206d587b927 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:51:07 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" returned: 0 in 0.307s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" released by "_copy_volume_from_snapshot" :: held 12.795s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-a290d778-2daf-4031-99e5-2ae2fd51e841" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-a290d778-2daf-4031-99e5-2ae2fd51e841" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Deleting offline snapshot a290d778-2daf-4031-99e5-2ae2fd51e841 of volume c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] snapshot_file for this snap is: volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62ec9b-c4c6-47cc-b363-74198df31924]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:51:08 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Image download 0.00 MB at 0.00 MB/s Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bcc388-56fa-442a-9074-f38bd07b7321]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:08 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:51:08 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:08 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:08 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:08 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:08 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.597s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20995ed-b464-4171-bd73-14a44e642438]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:08 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:08 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:08 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:51:08 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:09 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 1 in 0.478s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Temporary image 7618c6f6-99fe-4aa9-b945-d206d587b927 is fetched for user 1102d124999b46ba80da657d9ef2bc46. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[be530dae-2b9a-4417-9219-6e64007a4657]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:09 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:09 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:09 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.734s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:09 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:51:09 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:09 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:09 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:09 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:10 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.532s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:10 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841 Sep 25 12:51:10 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:10 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 1 in 0.532s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:10 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6.a290d778-2daf-4031-99e5-2ae2fd51e841" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-a290d778-2daf-4031-99e5-2ae2fd51e841" released by "_delete_snapshot" :: held 2.360s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.737s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-90cb5372-5da0-402b-87ec-6b623fa252cf req-cf3ec68e-99d5-45b2-a3aa-14682d4a9d68 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.669s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-90cb5372-5da0-402b-87ec-6b623fa252cf req-cf3ec68e-99d5-45b2-a3aa-14682d4a9d68 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.191s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e87fbb8-34eb-4340-965c-c2f2e37e379e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8d61e264c4597ab74d7d7a4cfa31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:07Z,use_quota=True,user_id='1102d124999b46ba80da657d9ef2bc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666cc9ca-ba08-42ff-ab73-157bdb688e58),volume_type_id=666cc9ca-ba08-42ff-ab73-157bdb688e58)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Creating volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:10 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80e4357-dd6a-4330-b6ff-8bde83a12ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab', 'volume_size': 1, 'source_volid': 'c0b1de3e-ad0b-443b-ab72-f83245b72ad6', 'source_volstatus': 'available'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a250755-0440-4a2a-a903-9d17f2fae612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1073741824 Sep 25 12:51:10 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:10 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Volume volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab (fc8fe848-363f-44d2-8162-e11ccd0fa0ab): created successfully Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a250755-0440-4a2a-a903-9d17f2fae612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (d124bbca-2874-4782-acee-76c6ad5bf01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-90cb5372-5da0-402b-87ec-6b623fa252cf req-cf3ec68e-99d5-45b2-a3aa-14682d4a9d68 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd71d297-6896-4b7e-97e0-fcb18ee6028a', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:51:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cd5f124b-3b20-4064-b0ff-930027dbeec2 tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:51:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-90cb5372-5da0-402b-87ec-6b623fa252cf req-cf3ec68e-99d5-45b2-a3aa-14682d4a9d68 tempest-TestServerVolumeAttachmentScenario-1831001555 None] attachment_update completed successfully. Sep 25 12:51:11 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1073741824" returned: 0 in 0.714s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:11 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e Sep 25 12:51:11 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:11 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e" returned: 0 in 0.386s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Attempting download of 7618c6f6-99fe-4aa9-b945-d206d587b927 ((None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}])) to volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[19409d5d-4e03-4455-9171-fff4fd8f8077]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:12 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0 Sep 25 12:51:12 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:12 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0" returned: 0 in 0.638s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:12 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0 Sep 25 12:51:12 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0" returned: 1 in 0.628s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7618c6f6-99fe-4aa9-b945-d206d587b927_hucm4my0' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e7372-798d-4c27-9d00-4f291a40234d]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (b1700add-5a0b-44c8-b3b3-50db3013b25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b66afa-4739-4b65-9332-d85c7be38053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b66afa-4739-4b65-9332-d85c7be38053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-162282785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30d2d05-a234-4efa-ba4d-0a94d812fa81,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6a5767-7d49-4040-8b7e-8ef063bc3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6a5767-7d49-4040-8b7e-8ef063bc3889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:13 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef54ce8-dd5f-456f-a89b-f9bc2b281667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef54ce8-dd5f-456f-a89b-f9bc2b281667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30d2d05-a234-4efa-ba4d-0a94d812fa81', 'volume_name': 'volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe899297-707d-4dfc-87ea-249a99c2f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe899297-707d-4dfc-87ea-249a99c2f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1898f2-408f-4796-b11e-5e2609fcbaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Volume d30d2d05-a234-4efa-ba4d-0a94d812fa81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81', 'volume_size': 1} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-162282785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30d2d05-a234-4efa-ba4d-0a94d812fa81,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Creating volume d30d2d05-a234-4efa-ba4d-0a94d812fa81 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:13 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 1073741824 Sep 25 12:51:13 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (8fa414fb-97bb-4505-9070-fe5c6397500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e847e3-756f-429b-923c-7782a374f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e847e3-756f-429b-923c-7782a374f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-789613747',display_name='tempest-VolumesGetTest-Volume-1234895995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39497ca-2047-4c1f-8218-99d455e223cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cdd804-5a52-4024-bc21-f137697f7ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cdd804-5a52-4024-bc21-f137697f7ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a7a94d-8b0f-49fe-b64a-34d43668416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a7a94d-8b0f-49fe-b64a-34d43668416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39497ca-2047-4c1f-8218-99d455e223cc', 'volume_name': 'volume-e39497ca-2047-4c1f-8218-99d455e223cc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f2bf5-6a69-4ff9-a663-6dcdbfbd7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f2bf5-6a69-4ff9-a663-6dcdbfbd7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b192c82b-1511-467a-84d8-65743cd4c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Volume e39497ca-2047-4c1f-8218-99d455e223cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39497ca-2047-4c1f-8218-99d455e223cc', 'volume_size': 1} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD Sep 25 12:51:13 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD" returned: 1 in 0.449s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] 7618c6f6-99fe-4aa9-b945-d206d587b927 was raw, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:14 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e Sep 25 12:51:14 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 1073741824" returned: 0 in 0.740s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:14 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 Sep 25 12:51:14 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81" returned: 0 in 0.355s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-789613747',display_name='tempest-VolumesGetTest-Volume-1234895995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39497ca-2047-4c1f-8218-99d455e223cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Creating volume e39497ca-2047-4c1f-8218-99d455e223cc {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:14 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1898f2-408f-4796-b11e-5e2609fcbaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7a91c6-1b4d-408b-81a6-35180e277f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:14 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc 1073741824 Sep 25 12:51:14 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Volume volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 (d30d2d05-a234-4efa-ba4d-0a94d812fa81): created successfully Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7a91c6-1b4d-408b-81a6-35180e277f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (b1700add-5a0b-44c8-b3b3-50db3013b25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4a9050c9-7450-4216-a405-b75a000011ba tempest-VolumesListTestJSON-1548851757 None] Created volume successfully. Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e" returned: 0 in 0.756s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7618c6f6-99fe-4aa9-b945-d206d587b927_ijoky6h4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:51:14 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 12:51:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:14 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1G Sep 25 12:51:14 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:15 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc 1073741824" returned: 0 in 0.739s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:15 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e 1G" returned: 0 in 0.534s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Downloaded image 7618c6f6-99fe-4aa9-b945-d206d587b927 ((None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}])) to volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Temporary image 7618c6f6-99fe-4aa9-b945-d206d587b927 for user 1102d124999b46ba80da657d9ef2bc46 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Marking volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Copying metadata from image 7618c6f6-99fe-4aa9-b945-d206d587b927 to 9e87fbb8-34eb-4340-965c-c2f2e37e379e. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Creating volume glance metadata for volume 9e87fbb8-34eb-4340-965c-c2f2e37e379e backed by image 7618c6f6-99fe-4aa9-b945-d206d587b927 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b409a270d0e286eca5c70f1235f8243c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:51:15 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc Sep 25 12:51:15 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5c10c-e52f-4b81-8eef-5b502c430974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e', 'volume_size': 1, 'image_id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7618c6f6-99fe-4aa9-b945-d206d587b927', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b409a270d0e286eca5c70f1235f8243c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ff8d61e264c4597ab74d7d7a4cfa31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c9f48748bd84e6adf997b786c330859e54f58c3816e3adc559d27cc2209cf78a3dcfa5245f7ffd0186c11e7c2349cd3fd3c4556898b2131eb02d324b1ec23a50', 'id': '7618c6f6-99fe-4aa9-b945-d206d587b927', 'created_at': datetime.datetime(2026, 9, 25, 10, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7618c6f6-99fe-4aa9-b945-d206d587b927/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cdfdfc-0cb1-473d-8b8c-7c07ea2bb9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Volume volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e (9e87fbb8-34eb-4340-965c-c2f2e37e379e): created successfully Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cdfdfc-0cb1-473d-8b8c-7c07ea2bb9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Flow 'volume_create_manager' (594d13ca-1bc3-4dce-8b24-4ab69659646b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5557e8d4-9a92-4b55-96e3-2f7a3a739a5d tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Created volume successfully. Sep 25 12:51:15 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc" returned: 0 in 0.461s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b192c82b-1511-467a-84d8-65743cd4c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39497ca-2047-4c1f-8218-99d455e223cc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362f4469-3402-487b-9477-145459667e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Volume volume-e39497ca-2047-4c1f-8218-99d455e223cc (e39497ca-2047-4c1f-8218-99d455e223cc): created successfully Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362f4469-3402-487b-9477-145459667e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (8fa414fb-97bb-4505-9070-fe5c6397500e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d16d1f42-3137-4d05-892a-725eb9e9f4db tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (d512d501-ec76-4412-aaf3-9e3d6a41dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a490ff2-c9a0-4702-9206-1333863f4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a490ff2-c9a0-4702-9206-1333863f4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599385959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3d2076-3345-4a84-93d6-38081c62bae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:16Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d626a88-f98d-417c-8746-ed0738e3e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d626a88-f98d-417c-8746-ed0738e3e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73549911-c580-4829-bca6-417c31336b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73549911-c580-4829-bca6-417c31336b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3d2076-3345-4a84-93d6-38081c62bae0', 'volume_name': 'volume-5d3d2076-3345-4a84-93d6-38081c62bae0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230be56-7a58-429e-84c9-c2e967bd56b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d230be56-7a58-429e-84c9-c2e967bd56b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51adb2f7-eff9-4267-a5af-83b54aaebcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Volume 5d3d2076-3345-4a84-93d6-38081c62bae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3d2076-3345-4a84-93d6-38081c62bae0', 'volume_size': 1} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599385959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3d2076-3345-4a84-93d6-38081c62bae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:16Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Creating volume 5d3d2076-3345-4a84-93d6-38081c62bae0 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:16 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:16 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 1073741824 Sep 25 12:51:16 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Acquiring lock "cinder-9e87fbb8-34eb-4340-965c-c2f2e37e379e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "cinder-9e87fbb8-34eb-4340-965c-c2f2e37e379e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Acquiring lock "cinder-quobyte-9e87fbb8-34eb-4340-965c-c2f2e37e379e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "cinder-quobyte-9e87fbb8-34eb-4340-965c-c2f2e37e379e" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566dda9-9450-40b9-9928-21868ee95c23]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-e39497ca-2047-4c1f-8218-99d455e223cc-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "cinder-e39497ca-2047-4c1f-8218-99d455e223cc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:17 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e Sep 25 12:51:17 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-e39497ca-2047-4c1f-8218-99d455e223cc" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-e39497ca-2047-4c1f-8218-99d455e223cc" acquired by "delete_volume" :: waited 0.059s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5e8bb6-1b3c-4ace-afac-9fef07db844e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:17 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc Sep 25 12:51:17 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 1073741824" returned: 0 in 1.073s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:17 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 Sep 25 12:51:17 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e" returned: 0 in 0.832s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:17 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e Sep 25 12:51:17 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f2093ef2-b21d-4e76-bcd9-714ff4e9a1dd req-5a760ec0-a894-4444-a644-df8291141ad1 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:17 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc" returned: 0 in 0.646s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f2093ef2-b21d-4e76-bcd9-714ff4e9a1dd req-5a760ec0-a894-4444-a644-df8291141ad1 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.201s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:18 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc Sep 25 12:51:18 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51adb2f7-eff9-4267-a5af-83b54aaebcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3d2076-3345-4a84-93d6-38081c62bae0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c049cc-8605-4f85-9e73-f5f00c147af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-f2093ef2-b21d-4e76-bcd9-714ff4e9a1dd req-5a760ec0-a894-4444-a644-df8291141ad1 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Volume volume-5d3d2076-3345-4a84-93d6-38081c62bae0 (5d3d2076-3345-4a84-93d6-38081c62bae0): created successfully Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c049cc-8605-4f85-9e73-f5f00c147af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (d512d501-ec76-4412-aaf3-9e3d6a41dae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-00f50a61-1ef1-4794-8d0e-6c6cd97af40e tempest-VolumesListTestJSON-1548851757 None] Created volume successfully. Sep 25 12:51:18 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9e87fbb8-34eb-4340-965c-c2f2e37e379e" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-f2093ef2-b21d-4e76-bcd9-714ff4e9a1dd req-5a760ec0-a894-4444-a644-df8291141ad1 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-c1224e8f-2757-4eef-ad26-291edd568720', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '319ac048-63ea-40b4-ba17-cc589a56c51d', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "cinder-quobyte-9e87fbb8-34eb-4340-965c-c2f2e37e379e" released by "delete_volume" :: held 1.371s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:18 devstack cinder-volume[87094]: WARNING cinder.quota [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:51:18 devstack cinder-volume[87094]: WARNING cinder.quota [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Created reservations ['f5e517f7-ee12-4315-8d27-e3a13d6b0c46', 'e83eef4f-04eb-41f1-adcc-7ba238974f8d', 'd9e73ce2-8b86-4069-afdf-c9d828560cbd', '54da5bd9-42fd-46c3-a5ff-3534141a94ad'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-f2093ef2-b21d-4e76-bcd9-714ff4e9a1dd req-5a760ec0-a894-4444-a644-df8291141ad1 tempest-TestServerVolumeAttachmentScenario-1831001555 None] attachment_update completed successfully. Sep 25 12:51:18 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e39497ca-2047-4c1f-8218-99d455e223cc" returned: 0 in 0.468s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-e39497ca-2047-4c1f-8218-99d455e223cc" released by "delete_volume" :: held 1.222s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:18 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Created reservations ['9f7b5254-9d2d-412f-b227-6ea1ffe6dcbb', 'b73aaeda-bd4b-4797-b061-984cd350edcb', '287a5835-de52-4b27-8bc6-2ae8a65d41c7', 'd2de283a-4b71-4486-a60b-7c4570372083'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:18 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.381s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Deleted volume successfully. Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6a6929c1-61a1-4dbc-bf04-925d488c1f64 tempest-VolumeAndVolumeTypeFromImageTest-1278254320 None] Lock "cinder-9e87fbb8-34eb-4340-965c-c2f2e37e379e-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:19 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3b83c22a-52a2-45fb-b2e5-06c2ade61a29 tempest-VolumesGetTest-592094836 None] Lock "cinder-e39497ca-2047-4c1f-8218-99d455e223cc-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-fc8fe848-363f-44d2-8162-e11ccd0fa0ab-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (0b945ff4-6902-4493-a8ec-07e6dafcf8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af3857f-ab1e-490e-bf16-b0d357a2a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "cinder-fc8fe848-363f-44d2-8162-e11ccd0fa0ab-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af3857f-ab1e-490e-bf16-b0d357a2a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1506045537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39534e4f-1d30-4b30-8f5d-ad5257136cf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:20Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba5c60c-7b14-499d-bcfd-9d9194b07cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba5c60c-7b14-499d-bcfd-9d9194b07cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc5976-ebe2-496b-aa87-f467a4f9267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc5976-ebe2-496b-aa87-f467a4f9267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39534e4f-1d30-4b30-8f5d-ad5257136cf2', 'volume_name': 'volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a6c627-c1e2-4f35-91d5-515028711358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a6c627-c1e2-4f35-91d5-515028711358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad44d171-33f0-4e5c-98d8-e6d667bbe91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Volume 39534e4f-1d30-4b30-8f5d-ad5257136cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2', 'volume_size': 1} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1506045537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39534e4f-1d30-4b30-8f5d-ad5257136cf2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3ef5dfba2794b57be7d676de545ed1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:20Z,use_quota=True,user_id='b7678021a3b445c49c5915e2fd1c87e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Creating volume 39534e4f-1d30-4b30-8f5d-ad5257136cf2 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:20 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:20 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 1073741824 Sep 25 12:51:20 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97c9fc-0c94-4512-b70d-6dc89d0a380e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:20 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab Sep 25 12:51:20 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:20 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" returned: 0 in 0.679s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:20 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 1073741824" returned: 0 in 0.870s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:20 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab Sep 25 12:51:20 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 Sep 25 12:51:21 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-96c722a3-0535-4437-a98a-42d292ff13c8 req-448fbeb9-12f3-4419-97af-f4f3a924506d tempest-TestServerVolumeAttachmentScenario-1831001555 None] Terminate volume connection completed successfully. Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-96c722a3-0535-4437-a98a-42d292ff13c8 req-448fbeb9-12f3-4419-97af-f4f3a924506d tempest-TestServerVolumeAttachmentScenario-1831001555 None] Deleting attachment 319ac048-63ea-40b4-ba17-cc589a56c51d. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:51:21 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:21 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" returned: 0 in 0.462s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2" returned: 0 in 0.359s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-fc8fe848-363f-44d2-8162-e11ccd0fa0ab" released by "delete_volume" :: held 1.233s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad44d171-33f0-4e5c-98d8-e6d667bbe91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dfba51-70d9-4d34-b279-a062b284a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Volume volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 (39534e4f-1d30-4b30-8f5d-ad5257136cf2): created successfully Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36dfba51-70d9-4d34-b279-a062b284a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Flow 'volume_create_manager' (0b945ff4-6902-4493-a8ec-07e6dafcf8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fc4a10bd-86ce-4044-8515-09f5b9c9f444 tempest-VolumesListTestJSON-1548851757 None] Created volume successfully. Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Created reservations ['0b8f5fc8-853c-46f9-a0b3-fca682b2dc38', 'd6fa9dfe-ddfc-4944-a7cb-19f5f40be933', '3a0eaa11-14a7-4cc5-b51b-85e1a9e1afa5', '9b21967f-327c-4b2e-b894-80383e81e7cb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:21 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:22 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.518s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-04ea8c88-c972-4082-9189-0b7cf1378fab tempest-VolumesGetTest-592094836 None] Lock "cinder-fc8fe848-363f-44d2-8162-e11ccd0fa0ab-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-c0b1de3e-ad0b-443b-ab72-f83245b72ad6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "cinder-c0b1de3e-ad0b-443b-ab72-f83245b72ad6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb51015-2e87-4090-95ff-be78dd27a4a1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:22 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:51:22 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:23 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.746s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:23 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6 Sep 25 12:51:23 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-c164e05b-61cf-4515-8707-2be2d7c045cc req-7074f8f4-6c3e-4691-b2dc-85b8177e9d5b tempest-TestServerVolumeAttachmentScenario-1831001555 None] Terminate volume connection completed successfully. Sep 25 12:51:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c164e05b-61cf-4515-8707-2be2d7c045cc req-7074f8f4-6c3e-4691-b2dc-85b8177e9d5b tempest-TestServerVolumeAttachmentScenario-1831001555 None] Deleting attachment fd71d297-6896-4b7e-97e0-fcb18ee6028a. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:51:24 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" returned: 0 in 0.533s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-c0b1de3e-ad0b-443b-ab72-f83245b72ad6" released by "delete_volume" :: held 1.408s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Created reservations ['7637deef-df95-4159-800e-0133cb50d063', '6a9dc6a8-905f-4c64-af1d-8c736bfec55d', '2914cee9-ce2a-4ca9-a94f-468705a49bc2', '557c6a8a-193f-4e98-81e7-ee341cd4d16b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:24 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:24 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:24 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:51:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f49d46be-f944-492b-8d5d-f896e8314978 tempest-VolumesGetTest-592094836 None] Lock "cinder-c0b1de3e-ad0b-443b-ab72-f83245b72ad6-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-39534e4f-1d30-4b30-8f5d-ad5257136cf2-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-39534e4f-1d30-4b30-8f5d-ad5257136cf2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-quobyte-39534e4f-1d30-4b30-8f5d-ad5257136cf2" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-39534e4f-1d30-4b30-8f5d-ad5257136cf2" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa35dbf8-06f2-465d-bda0-3e882b51b64c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:26 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 Sep 25 12:51:26 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (d7f0dee4-894c-41cb-9b05-fb4b9f3be78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed516de-13ea-4773-bfd1-b4011d94ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed516de-13ea-4773-bfd1-b4011d94ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-378532361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32ac91-efc9-4fff-8ba1-c54610f75182,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:27Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa7cecc-d068-45a3-83d3-904effba25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa7cecc-d068-45a3-83d3-904effba25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4742062-2208-44a9-835b-5b8ad9fc3457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:51:27 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2" returned: 0 in 1.041s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:27 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2 Sep 25 12:51:27 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:27 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4742062-2208-44a9-835b-5b8ad9fc3457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d32ac91-efc9-4fff-8ba1-c54610f75182', 'volume_name': 'volume-0d32ac91-efc9-4fff-8ba1-c54610f75182', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3985843-29da-4299-a059-49c8965067cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3985843-29da-4299-a059-49c8965067cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ecb41a-93f3-49ae-80f7-fcf9beacd970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:27 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Volume 0d32ac91-efc9-4fff-8ba1-c54610f75182: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d32ac91-efc9-4fff-8ba1-c54610f75182', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Trying to clone 0d32ac91-efc9-4fff-8ba1-c54610f75182 from image d090291b-21f1-4593-a719-dd6e6ea3f284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-39534e4f-1d30-4b30-8f5d-ad5257136cf2" returned: 0 in 0.656s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-39534e4f-1d30-4b30-8f5d-ad5257136cf2" released by "delete_volume" :: held 1.811s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:27 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Created reservations ['745409b4-60c3-40bc-aed3-e22e6882695c', '5069b40c-edeb-498c-b5f3-53e65940c02b', '624c8f7c-6f55-4d8a-87c8-978f635ea677', '2c78c406-3b6e-44dc-9d6f-12931206052c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:28 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:28 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:51:28 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-5d3d2076-3345-4a84-93d6-38081c62bae0-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-5d3d2076-3345-4a84-93d6-38081c62bae0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6d6482-926a-48ca-bdb4-b5599e80d488]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-quobyte-5d3d2076-3345-4a84-93d6-38081c62bae0" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-5d3d2076-3345-4a84-93d6-38081c62bae0" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[56214c0d-93bb-420b-83b7-349de1fa5f14]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:28 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD Sep 25 12:51:28 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:28 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 Sep 25 12:51:28 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:29 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.794s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Deleted volume successfully. Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (4f339617-38bb-4d21-9170-27f56fef8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3705491-a6e2-441d-9d0d-6270f6cde4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d7720ebf-a467-4d66-aacf-6d30ed5ab4ad tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-39534e4f-1d30-4b30-8f5d-ad5257136cf2-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3705491-a6e2-441d-9d0d-6270f6cde4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809554853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b310c36-7edc-4d7f-a123-9311efc1706b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:29Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8749dbd6-500b-41af-8ed0-21451d7c6d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8749dbd6-500b-41af-8ed0-21451d7c6d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d412d-31e5-464e-8989-4d4554e65c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55d412d-31e5-464e-8989-4d4554e65c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b310c36-7edc-4d7f-a123-9311efc1706b', 'volume_name': 'volume-2b310c36-7edc-4d7f-a123-9311efc1706b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd9b2ce-5215-45d5-86d7-b00faf77d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd9b2ce-5215-45d5-86d7-b00faf77d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195003bd-45bb-4684-aee4-200270fa54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Volume 2b310c36-7edc-4d7f-a123-9311efc1706b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b310c36-7edc-4d7f-a123-9311efc1706b', 'volume_size': 1} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809554853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b310c36-7edc-4d7f-a123-9311efc1706b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:29Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Creating volume 2b310c36-7edc-4d7f-a123-9311efc1706b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:29 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:29 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 is fetched for user 07a6c6717e5548509756dd60f658e8e9. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:51:29 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b 1073741824 Sep 25 12:51:29 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75b865-02fa-415b-a33f-41e1d5648cd9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:29 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0" returned: 0 in 0.954s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:29 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD Sep 25 12:51:29 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:29 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0 Sep 25 12:51:29 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:30 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (6e82b4a3-ad9b-4e61-8afd-688e7340dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d5e2b7-3efd-4f8a-aa5d-047a470ef45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5d3d2076-3345-4a84-93d6-38081c62bae0" returned: 0 in 0.745s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:30 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD" returned: 0 in 1.003s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-5d3d2076-3345-4a84-93d6-38081c62bae0" released by "delete_volume" :: held 1.845s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d5e2b7-3efd-4f8a-aa5d-047a470ef45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311075213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7473a43-1a78-441a-b63c-d4d256d17c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:30Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835879d7-bb2e-416b-8fbd-4fac535124e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835879d7-bb2e-416b-8fbd-4fac535124e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:30 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3622060b-b856-46e5-b63d-1bb3c3685b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3622060b-b856-46e5-b63d-1bb3c3685b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7473a43-1a78-441a-b63c-d4d256d17c98', 'volume_name': 'volume-c7473a43-1a78-441a-b63c-d4d256d17c98', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d933d1c3-4586-4af6-adda-48366c385b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d933d1c3-4586-4af6-adda-48366c385b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d662bee-d77a-49e3-99e4-5d1f3df097c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Volume c7473a43-1a78-441a-b63c-d4d256d17c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7473a43-1a78-441a-b63c-d4d256d17c98', 'volume_size': 1} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b 1073741824" returned: 0 in 1.331s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:30 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b Sep 25 12:51:30 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Created reservations ['c4d84c54-9d42-4706-81a3-151fdd120250', 'd7061973-6443-4ffd-b5f3-5c0fe2470822', '4eb91301-146d-4820-8a18-ec62eff9df9d', '865be07b-0cab-400a-a9bb-df51b4147b0b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:31 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:31 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (b0471c9e-f6b6-48f7-803a-51339d499267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49216fc7-b260-4143-9fb2-b6bbbfa2a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49216fc7-b260-4143-9fb2-b6bbbfa2a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385116234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f4212-ccff-4aa3-8a7e-1258864ab23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:31Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af21d95-7454-4cdd-86b4-cb7769c05933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af21d95-7454-4cdd-86b4-cb7769c05933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b822913d-2880-4213-afa6-274799979ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b822913d-2880-4213-afa6-274799979ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9f4212-ccff-4aa3-8a7e-1258864ab23d', 'volume_name': 'volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714346b7-efa9-4a37-9499-e7be8cc66aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714346b7-efa9-4a37-9499-e7be8cc66aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d833ada5-e08b-4886-a852-4a0943e40d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Volume bd9f4212-ccff-4aa3-8a7e-1258864ab23d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d', 'volume_size': 1} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-d30d2d05-a234-4efa-ba4d-0a94d812fa81-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b" returned: 0 in 0.742s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-378532361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d32ac91-efc9-4fff-8ba1-c54610f75182,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:27Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Creating volume 0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:31 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:31 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1073741824 Sep 25 12:51:31 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:31 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195003bd-45bb-4684-aee4-200270fa54e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b310c36-7edc-4d7f-a123-9311efc1706b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b85d2f3-7fc1-45ff-863b-76f34e0dc9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-d30d2d05-a234-4efa-ba4d-0a94d812fa81-delete_volume" acquired by "delete_volume" :: waited 0.206s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.770s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Volume volume-2b310c36-7edc-4d7f-a123-9311efc1706b (2b310c36-7edc-4d7f-a123-9311efc1706b): created successfully Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b85d2f3-7fc1-45ff-863b-76f34e0dc9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (4f339617-38bb-4d21-9170-27f56fef8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Deleted volume successfully. Sep 25 12:51:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-727aef98-6d9c-41b7-8aee-7d03bae9fe65 tempest-CreateVolumesFromImageTest-1406163545 None] Created volume successfully. Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-5368ada7-3d28-4703-bfea-0699945a30be tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-5d3d2076-3345-4a84-93d6-38081c62bae0-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "cinder-quobyte-d30d2d05-a234-4efa-ba4d-0a94d812fa81" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-d30d2d05-a234-4efa-ba4d-0a94d812fa81" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d6a704-bfe0-4110-a359-535f6d7810d0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:32 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 Sep 25 12:51:32 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (304afedb-e302-44dc-b78f-0bed5ac21b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76f8ad2-dfd1-40ad-91a6-01ddce066a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76f8ad2-dfd1-40ad-91a6-01ddce066a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951140428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:32Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452abbc7-74fa-497b-97c2-8c6ccb16c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452abbc7-74fa-497b-97c2-8c6ccb16c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b39fb-69f3-465e-97ef-301caf1c5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b39fb-69f3-465e-97ef-301caf1c5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9', 'volume_name': 'volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87619c-2499-4413-95a6-0de82eded0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87619c-2499-4413-95a6-0de82eded0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d67d07c-4584-41d7-83e4-5b7f3f2085ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Volume ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9', 'volume_size': 1} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1073741824" returned: 0 in 0.945s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:32 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 Sep 25 12:51:32 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:32 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81" returned: 0 in 0.926s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:32 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81 Sep 25 12:51:32 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:33 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182" returned: 0 in 0.586s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.483s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-311075213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7473a43-1a78-441a-b63c-d4d256d17c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:30Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Creating volume c7473a43-1a78-441a-b63c-d4d256d17c98 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:33 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:33 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 1073741824 Sep 25 12:51:33 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Attempting download of d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 0d32ac91-efc9-4fff-8ba1-c54610f75182. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (a65905e5-4773-45c1-adbf-c9d9eeefcc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1074e966-6765-42dc-bfe0-b8fb379d8a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1074e966-6765-42dc-bfe0-b8fb379d8a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670247464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3f38f-6031-4da2-a669-de26cc39f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:33Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42807c17-b1ee-4692-b054-c14d233b3977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42807c17-b1ee-4692-b054-c14d233b3977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8a6573-d6c0-491d-905a-0c0f8bdfe62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8a6573-d6c0-491d-905a-0c0f8bdfe62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da3f38f-6031-4da2-a669-de26cc39f67d', 'volume_name': 'volume-5da3f38f-6031-4da2-a669-de26cc39f67d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834b4ef-f4eb-4d61-b769-ad043e3f178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834b4ef-f4eb-4d61-b769-ad043e3f178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ece431-ff32-4d9e-9f8f-8d0b3ab28fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Volume 5da3f38f-6031-4da2-a669-de26cc39f67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da3f38f-6031-4da2-a669-de26cc39f67d', 'volume_size': 1} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[727de1e6-b43c-49a3-8f0a-8850d9dcfb20]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:33 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d30d2d05-a234-4efa-ba4d-0a94d812fa81" returned: 0 in 0.585s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-quobyte-d30d2d05-a234-4efa-ba4d-0a94d812fa81" released by "delete_volume" :: held 1.601s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:33 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8 Sep 25 12:51:33 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Created reservations ['1c5a8422-fae3-4ea2-995e-3fd63743639f', 'bbddca16-7840-4133-b620-d06a77267b15', '60e74161-5fbf-4520-8954-3e90b85ab88a', 'cec4b4ea-4cd0-4613-b14b-8bfdd9f99f11'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "cinder-c1224e8f-2757-4eef-ad26-291edd568720-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-c1224e8f-2757-4eef-ad26-291edd568720-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:33 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:33 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "cinder-quobyte-c1224e8f-2757-4eef-ad26-291edd568720" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-quobyte-c1224e8f-2757-4eef-ad26-291edd568720" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:34 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8" returned: 0 in 0.693s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e7c84-d3c5-4f6a-a931-944f71fc5e86]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 1073741824" returned: 0 in 0.966s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 Sep 25 12:51:34 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8 Sep 25 12:51:34 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 Sep 25 12:51:34 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.559s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Deleted volume successfully. Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-de9e03c7-d86d-42be-8a34-099b0ec2440f tempest-VolumesListTestJSON-1548851757 None] Lock "cinder-d30d2d05-a234-4efa-ba4d-0a94d812fa81-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:34 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8" returned: 1 in 0.512s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_28ovdvo8' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d247d9-52c4-4263-8e83-e283437ac7d2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98" returned: 0 in 0.493s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.258s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385116234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f4212-ccff-4aa3-8a7e-1258864ab23d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:31Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Creating volume bd9f4212-ccff-4aa3-8a7e-1258864ab23d {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:34 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD Sep 25 12:51:34 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d 1073741824 Sep 25 12:51:34 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d662bee-d77a-49e3-99e4-5d1f3df097c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7473a43-1a78-441a-b63c-d4d256d17c98', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c92f1-bc8a-44b3-a118-e035acca5da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720" returned: 0 in 0.687s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Volume volume-c7473a43-1a78-441a-b63c-d4d256d17c98 (c7473a43-1a78-441a-b63c-d4d256d17c98): created successfully Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c92f1-bc8a-44b3-a118-e035acca5da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:34 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720 Sep 25 12:51:34 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (6e82b4a3-ad9b-4e61-8afd-688e7340dedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b66f2530-3958-48c5-a755-ed6c06765aa9 tempest-CreateVolumesFromImageTest-1406163545 None] Created volume successfully. Sep 25 12:51:35 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] d090291b-21f1-4593-a719-dd6e6ea3f284 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:35 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c1224e8f-2757-4eef-ad26-291edd568720" returned: 0 in 0.499s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:35 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 Sep 25 12:51:35 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-quobyte-c1224e8f-2757-4eef-ad26-291edd568720" released by "delete_volume" :: held 1.313s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Created reservations ['6879f163-87b8-478a-bb75-f58565638c42', 'c2504920-19fe-4988-b8a6-15dfcf660e64', '083d5e17-0ac7-40f5-9edb-7ed02f24afc0', '7dfbb2a6-4d9f-4bee-a429-e6ea763e896e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:35 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d 1073741824" returned: 0 in 0.770s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:35 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:35 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:35 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d Sep 25 12:51:35 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:35 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" returned: 0 in 0.446s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.596s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951140428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:32Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Creating volume ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:36 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:36 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.561s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:36 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 1073741824 Sep 25 12:51:36 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Deleted volume successfully. Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d833ada5-e08b-4886-a852-4a0943e40d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a763794b-c072-44f0-ab23-aa474b5213c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "cinder-9891e91b-b4f5-4923-9dfd-35dfe40d1884-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-fc32743e-bd4f-434f-ae76-e4b00735c0d5 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-c1224e8f-2757-4eef-ad26-291edd568720-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:36 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Volume volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d (bd9f4212-ccff-4aa3-8a7e-1258864ab23d): created successfully Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a763794b-c072-44f0-ab23-aa474b5213c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (b0471c9e-f6b6-48f7-803a-51339d499267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-9891e91b-b4f5-4923-9dfd-35dfe40d1884-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0a0e5feb-e2eb-41e3-b6d0-19f8ad633649 tempest-CreateVolumesFromImageTest-1406163545 None] Created volume successfully. Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "cinder-quobyte-9891e91b-b4f5-4923-9dfd-35dfe40d1884" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-quobyte-9891e91b-b4f5-4923-9dfd-35dfe40d1884" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aaeefb-44fb-43ab-8b88-00931dc1b7bd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:36 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 Sep 25 12:51:36 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:37 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 1073741824" returned: 0 in 0.962s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:37 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 Sep 25 12:51:37 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:37 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884" returned: 0 in 0.777s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:37 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884 Sep 25 12:51:37 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:37 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" returned: 0 in 0.486s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.292s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670247464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3f38f-6031-4da2-a669-de26cc39f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c6b778921e4edab056987caf16424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:33Z,use_quota=True,user_id='238d899d313f4a2eb7a87039fc1ed76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Creating volume 5da3f38f-6031-4da2-a669-de26cc39f67d {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:37 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9891e91b-b4f5-4923-9dfd-35dfe40d1884" returned: 0 in 0.436s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:37 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d 1073741824 Sep 25 12:51:37 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d67d07c-4584-41d7-83e4-5b7f3f2085ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52300bf6-03de-4fc0-b378-830e7652ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-quobyte-9891e91b-b4f5-4923-9dfd-35dfe40d1884" released by "delete_volume" :: held 1.323s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Volume volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 (ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9): created successfully Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52300bf6-03de-4fc0-b378-830e7652ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (304afedb-e302-44dc-b78f-0bed5ac21b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5189ce3d-2224-45af-889c-59a3d0b7e4ce tempest-CreateVolumesFromImageTest-1406163545 None] Created volume successfully. Sep 25 12:51:37 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Created reservations ['77612ea5-e21b-4666-921a-0bd81ad8fbf7', '7ce62218-0015-472c-bdf2-e99f6ea9a744', '885c1508-7bed-4471-a98c-21d15ac066c9', 'bcf98990-fcee-49c3-8998-ca0a0dc4c4eb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:38 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:38 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:38 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d 1073741824" returned: 0 in 0.830s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:38 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182" returned: 0 in 3.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_y2kfd5ctdevstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:51:38 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Converted 112.00 MB image at 33.40 MB/s Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:38 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:38 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d Sep 25 12:51:38 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:38 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1G Sep 25 12:51:38 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Deleted volume successfully. Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7fa89884-79bd-40af-a950-1aa510d3c388 tempest-TestServerVolumeAttachmentScenario-1831001555 None] Lock "cinder-9891e91b-b4f5-4923-9dfd-35dfe40d1884-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:38 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ece431-ff32-4d9e-9f8f-8d0b3ab28fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da3f38f-6031-4da2-a669-de26cc39f67d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15dcaf9-eb1a-4827-a7dd-af9ab74b6514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Volume volume-5da3f38f-6031-4da2-a669-de26cc39f67d (5da3f38f-6031-4da2-a669-de26cc39f67d): created successfully Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15dcaf9-eb1a-4827-a7dd-af9ab74b6514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Flow 'volume_create_manager' (a65905e5-4773-45c1-adbf-c9d9eeefcc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-052df83b-aa37-4c4a-bdca-30d8671d391d tempest-CreateVolumesFromImageTest-1406163545 None] Created volume successfully. Sep 25 12:51:39 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 1G" returned: 0 in 0.647s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Downloaded image d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume 0d32ac91-efc9-4fff-8ba1-c54610f75182 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 for user 07a6c6717e5548509756dd60f658e8e9 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Marking volume 0d32ac91-efc9-4fff-8ba1-c54610f75182 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Copying metadata from image d090291b-21f1-4593-a719-dd6e6ea3f284 to 0d32ac91-efc9-4fff-8ba1-c54610f75182. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Creating volume glance metadata for volume 0d32ac91-efc9-4fff-8ba1-c54610f75182 backed by image d090291b-21f1-4593-a719-dd6e6ea3f284 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ecb41a-93f3-49ae-80f7-fcf9beacd970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d32ac91-efc9-4fff-8ba1-c54610f75182', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b987eea4-f82b-4a22-93cf-3e00d7cde008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:39 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Volume volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 (0d32ac91-efc9-4fff-8ba1-c54610f75182): created successfully Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b987eea4-f82b-4a22-93cf-3e00d7cde008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:39 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (d7f0dee4-894c-41cb-9b05-fb4b9f3be78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3780b4da-9358-443f-8a20-b31191f04167 tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-5da3f38f-6031-4da2-a669-de26cc39f67d-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-5da3f38f-6031-4da2-a669-de26cc39f67d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-quobyte-5da3f38f-6031-4da2-a669-de26cc39f67d" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-5da3f38f-6031-4da2-a669-de26cc39f67d" acquired by "delete_volume" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdd0ad-0b2a-4588-943b-99c3f3a52251]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:40 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d Sep 25 12:51:40 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:41 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d" returned: 0 in 0.704s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:41 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d Sep 25 12:51:41 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Flow 'volume_create_manager' (ef5db0b4-db70-4f69-8785-fa20048028b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fc3564-7061-42a1-a919-a8f9c0ef1e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fc3564-7061-42a1-a919-a8f9c0ef1e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1818090637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f6568a-e8a8-40da-a0c1-5b0a41446945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e863e4716348aeadae82635772adc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:41Z,use_quota=True,user_id='fd6365b283f04548b2a273d59ab67ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebf7bca-8756-429a-8568-a3ac12e07e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebf7bca-8756-429a-8568-a3ac12e07e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d51cce-852a-4b09-8b01-c8f3920d4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d51cce-852a-4b09-8b01-c8f3920d4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f6568a-e8a8-40da-a0c1-5b0a41446945', 'volume_name': 'volume-95f6568a-e8a8-40da-a0c1-5b0a41446945', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9952a97-c7c3-4122-b91d-98d22ffe477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9952a97-c7c3-4122-b91d-98d22ffe477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987cbe38-7b75-4efe-9d82-be8715f3a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:41 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Volume 95f6568a-e8a8-40da-a0c1-5b0a41446945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f6568a-e8a8-40da-a0c1-5b0a41446945', 'volume_size': 1} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1818090637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f6568a-e8a8-40da-a0c1-5b0a41446945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e863e4716348aeadae82635772adc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:41Z,use_quota=True,user_id='fd6365b283f04548b2a273d59ab67ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Creating volume 95f6568a-e8a8-40da-a0c1-5b0a41446945 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:41 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:41 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 1073741824 Sep 25 12:51:41 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:41 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-5da3f38f-6031-4da2-a669-de26cc39f67d" returned: 0 in 0.656s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-5da3f38f-6031-4da2-a669-de26cc39f67d" released by "delete_volume" :: held 1.436s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:41 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Created reservations ['c9161041-fc9f-44de-8778-97b75ca2ac9e', 'bf94fb5c-4786-42f5-ad83-003f669fdf1c', '6768744f-1dc7-44ce-a566-411aad01a936', '151f7e32-02e2-444b-8ac3-20b106f5fa61'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:42 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:42 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:42 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 1073741824" returned: 0 in 0.923s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:42 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.544s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (208cdd23-0178-4767-a387-b2c97e5c2c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67801741-dc74-4e16-986a-46eea9663584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Deleted volume successfully. Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67801741-dc74-4e16-986a-46eea9663584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-142623902',display_name='tempest-VolumesGetTest-Volume-1055047130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18012114-6cf4-4899-a8ba-fa798a6da0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:42Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4063fb0-d053-420e-b615-6d6dd5f95a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4063fb0-d053-420e-b615-6d6dd5f95a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8563d3-09e1-4f8a-a76b-6261384d5d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8563d3-09e1-4f8a-a76b-6261384d5d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18012114-6cf4-4899-a8ba-fa798a6da0f6', 'volume_name': 'volume-18012114-6cf4-4899-a8ba-fa798a6da0f6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58cf635-c40d-4a81-859b-4a6d5db996fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58cf635-c40d-4a81-859b-4a6d5db996fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad39095-af6c-4d1d-9541-eaf695fc47f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Volume 18012114-6cf4-4899-a8ba-fa798a6da0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18012114-6cf4-4899-a8ba-fa798a6da0f6', 'volume_size': 1} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4dfe03a3-8873-4093-952a-3c0285693b39 tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-5da3f38f-6031-4da2-a669-de26cc39f67d-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:42 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 Sep 25 12:51:42 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-quobyte-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd6ba5-7819-403b-a417-b2977d71d483]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:43 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 Sep 25 12:51:43 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:43 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945" returned: 0 in 0.440s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-142623902',display_name='tempest-VolumesGetTest-Volume-1055047130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18012114-6cf4-4899-a8ba-fa798a6da0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c5e6f4b7d74ed6a1a867a53a24ff9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:42Z,use_quota=True,user_id='07a6c6717e5548509756dd60f658e8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Creating volume 18012114-6cf4-4899-a8ba-fa798a6da0f6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:43 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:43 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 1073741824 Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987cbe38-7b75-4efe-9d82-be8715f3a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f6568a-e8a8-40da-a0c1-5b0a41446945', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:43 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288edf74-4528-453a-ac3b-7a516a5bf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:43 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Volume volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 (95f6568a-e8a8-40da-a0c1-5b0a41446945): created successfully Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288edf74-4528-453a-ac3b-7a516a5bf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Flow 'volume_create_manager' (ef5db0b4-db70-4f69-8785-fa20048028b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-34df5e66-79c8-47ab-8d6a-14f963a42870 tempest-VolumesNegativeTest-1772996111 None] Created volume successfully. Sep 25 12:51:43 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" returned: 0 in 0.660s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:43 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9 Sep 25 12:51:43 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:44 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:44 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" returned: 0 in 0.388s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 1073741824" returned: 0 in 0.747s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9" released by "delete_volume" :: held 1.131s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:44 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 Sep 25 12:51:44 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Created reservations ['abdb1614-8164-4d0e-a5ca-a4897987cc53', '23c52864-742c-40b6-99ea-5cac8498c4fd', '067f194a-2d96-4ad0-9c7c-4f0a96752fd6', '7c020d96-d1b0-4f66-a529-8e1b44b598d8'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:44 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:44 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:44 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6" returned: 0 in 0.504s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad39095-af6c-4d1d-9541-eaf695fc47f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18012114-6cf4-4899-a8ba-fa798a6da0f6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e59ac9-9d8c-41f8-b6ae-8b50f9785f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Volume volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 (18012114-6cf4-4899-a8ba-fa798a6da0f6): created successfully Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e59ac9-9d8c-41f8-b6ae-8b50f9785f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Flow 'volume_create_manager' (208cdd23-0178-4767-a387-b2c97e5c2c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:44 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.465s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Deleted volume successfully. Sep 25 12:51:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-df1281fb-3500-4999-b152-7546ea2b53fe tempest-VolumesGetTest-592094836 None] Created volume successfully. Sep 25 12:51:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-744fc397-90ac-47fe-a301-3059a75cc79e tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-ebcd2873-ba89-44b6-9f0f-a5e8ba9732d9-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-bd9f4212-ccff-4aa3-8a7e-1258864ab23d-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-bd9f4212-ccff-4aa3-8a7e-1258864ab23d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-quobyte-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da438ae-af9a-4356-8c68-8cffa0e80765]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:45 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d Sep 25 12:51:45 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-18012114-6cf4-4899-a8ba-fa798a6da0f6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:45 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" returned: 0 in 0.683s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "cinder-18012114-6cf4-4899-a8ba-fa798a6da0f6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:46 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d Sep 25 12:51:46 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-18012114-6cf4-4899-a8ba-fa798a6da0f6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-18012114-6cf4-4899-a8ba-fa798a6da0f6" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f1f21d-26ac-418e-a94b-02106ccd8286]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:46 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 Sep 25 12:51:46 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:46 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" returned: 0 in 0.559s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-bd9f4212-ccff-4aa3-8a7e-1258864ab23d" released by "delete_volume" :: held 1.314s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Created reservations ['f7c60159-aa9c-496e-ad8a-4b4840413190', 'fc924ab7-8202-47c6-9a67-c1e6b42265f9', '0f520239-0a77-460d-ac47-5d855e7b80c9', '1b8dc5db-1857-4d6d-af53-1624b4f20f59'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:46 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:46 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:46 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6" returned: 0 in 0.729s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:46 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6 Sep 25 12:51:46 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:47 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.437s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Deleted volume successfully. Sep 25 12:51:47 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:47 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0571278a-b4e1-430f-9694-f3daf656edfd tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-bd9f4212-ccff-4aa3-8a7e-1258864ab23d-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:47 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-18012114-6cf4-4899-a8ba-fa798a6da0f6" returned: 0 in 0.542s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-18012114-6cf4-4899-a8ba-fa798a6da0f6" released by "delete_volume" :: held 1.351s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-c7473a43-1a78-441a-b63c-d4d256d17c98-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Created reservations ['43721be7-9d4b-45f9-9d2f-83c1b02613f3', 'fe6c2282-c5a5-46e2-8b2e-3153413dc322', '48924087-689a-425b-b31a-1f9ae0db801c', '2d1842f9-950a-414e-a4f3-30b81b9b73cc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-c7473a43-1a78-441a-b63c-d4d256d17c98-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:47 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.507s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-quobyte-c7473a43-1a78-441a-b63c-d4d256d17c98" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-c7473a43-1a78-441a-b63c-d4d256d17c98" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95da53e-bcfb-47f0-b54e-ccda135e5151]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:48 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:48 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:48 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 Sep 25 12:51:48 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:48 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.540s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3a558584-7941-45be-a514-53234e7a9d6f tempest-VolumesGetTest-592094836 None] Lock "cinder-18012114-6cf4-4899-a8ba-fa798a6da0f6-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-0d32ac91-efc9-4fff-8ba1-c54610f75182-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "cinder-0d32ac91-efc9-4fff-8ba1-c54610f75182-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Acquiring lock "cinder-quobyte-0d32ac91-efc9-4fff-8ba1-c54610f75182" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-0d32ac91-efc9-4fff-8ba1-c54610f75182" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:48 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98" returned: 0 in 0.766s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fe470-14ff-494c-9c14-c782afdc0658]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:48 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98 Sep 25 12:51:48 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 Sep 25 12:51:49 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c7473a43-1a78-441a-b63c-d4d256d17c98" returned: 0 in 0.781s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-c7473a43-1a78-441a-b63c-d4d256d17c98" released by "delete_volume" :: held 1.677s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:49 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Created reservations ['98accdb4-603e-4772-82e0-46912b68debf', '94ecf7da-a4c5-4cd7-9e63-88d73c6ec230', '40e46204-d739-429e-a3cb-d4350480bea6', '9c6329ac-77b8-4cd2-bbb4-a01e7896fb14'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182" returned: 0 in 0.908s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:49 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182 Sep 25 12:51:49 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:49 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:49 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:50 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-0d32ac91-efc9-4fff-8ba1-c54610f75182" returned: 0 in 0.525s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "cinder-quobyte-0d32ac91-efc9-4fff-8ba1-c54610f75182" released by "delete_volume" :: held 1.542s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-2b310c36-7edc-4d7f-a123-9311efc1706b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-2b310c36-7edc-4d7f-a123-9311efc1706b-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:50 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.522s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Created reservations ['534f8f55-7330-4575-a665-c821edaf8f74', 'a1d18ab4-9cea-4474-92b5-8a2f745f12a7', 'f32041a1-a361-452b-9e4d-fedc771ab5db', '18e86987-fc21-4477-b597-84d9909186bf'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Deleted volume successfully. Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "cinder-quobyte-2b310c36-7edc-4d7f-a123-9311efc1706b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-05e30946-f776-4716-be9d-ecda223443bf tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-c7473a43-1a78-441a-b63c-d4d256d17c98-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-2b310c36-7edc-4d7f-a123-9311efc1706b" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9eb6fb-323d-4479-8d46-357f331a59df]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:50 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:50 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:50 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b Sep 25 12:51:50 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:51 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Deleted volume successfully. Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-57b5a10a-f163-4d97-a003-598def9b068f tempest-VolumesGetTest-592094836 None] Lock "cinder-0d32ac91-efc9-4fff-8ba1-c54610f75182-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:51 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b" returned: 0 in 0.702s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:51 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b Sep 25 12:51:51 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:51 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b310c36-7edc-4d7f-a123-9311efc1706b" returned: 0 in 0.403s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-quobyte-2b310c36-7edc-4d7f-a123-9311efc1706b" released by "delete_volume" :: held 1.199s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:51 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Created reservations ['88d4bab4-3f89-4cba-a078-09bfbe1ce082', '2c4c1e51-5bd9-4db4-b960-5c75ec31796d', '6216e071-eb07-49de-9783-ed5b8fc514c3', '15f77840-9665-4fe2-8dcb-7c7db0ab281d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:52 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:51:52 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:52 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.449s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Deleted volume successfully. Sep 25 12:51:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c240ce9e-3abe-431f-aecd-6e6ac3e3b93b tempest-CreateVolumesFromImageTest-1406163545 None] Lock "cinder-2b310c36-7edc-4d7f-a123-9311efc1706b-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (1620ab5f-5696-4e12-a902-d596ffc6caa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b65ed55-6465-4850-b835-eef7dfdc30dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b65ed55-6465-4850-b835-eef7dfdc30dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132666608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db08f4e-d2ff-4f70-b285-97620c4d41f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:00Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1083f7d1-a084-4e7b-a33d-d055d31e7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1083f7d1-a084-4e7b-a33d-d055d31e7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d9b09d-201e-4d3f-8979-b00f2f29a3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d9b09d-201e-4d3f-8979-b00f2f29a3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db08f4e-d2ff-4f70-b285-97620c4d41f9', 'volume_name': 'volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac02665-1283-49cf-8dff-62d65fb599af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac02665-1283-49cf-8dff-62d65fb599af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211dd480-aff2-427f-b3db-9f22ace08e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:00 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume 9db08f4e-d2ff-4f70-b285-97620c4d41f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9', 'volume_size': 1} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132666608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db08f4e-d2ff-4f70-b285-97620c4d41f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:00Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume 9db08f4e-d2ff-4f70-b285-97620c4d41f9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:00 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:00 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 1073741824 Sep 25 12:52:00 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:01 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 1073741824" returned: 0 in 0.934s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:01 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 Sep 25 12:52:01 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:02 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9" returned: 0 in 0.539s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211dd480-aff2-427f-b3db-9f22ace08e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf45286-fed8-4762-a375-82a9427a0cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 (9db08f4e-d2ff-4f70-b285-97620c4d41f9): created successfully Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf45286-fed8-4762-a375-82a9427a0cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (1620ab5f-5696-4e12-a902-d596ffc6caa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0435eb35-67c1-4679-92fb-e9d69da31d92 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:04 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (4db9b21d-24c1-42ad-8052-2e762c74f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7e4812-22b4-42f3-bd6a-116dcdf6eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7e4812-22b4-42f3-bd6a-116dcdf6eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925935543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f14590-9e67-4a98-a8e0-aa7657814ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:05Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:04 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094ea8e0-110f-414b-b901-944d83166d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094ea8e0-110f-414b-b901-944d83166d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b18d097-f4bf-4a97-bf6e-2ba1a2d845b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b18d097-f4bf-4a97-bf6e-2ba1a2d845b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f14590-9e67-4a98-a8e0-aa7657814ba7', 'volume_name': 'volume-36f14590-9e67-4a98-a8e0-aa7657814ba7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e756523-77d3-49ca-88d9-8f625611b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e756523-77d3-49ca-88d9-8f625611b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b3ac7d-c547-4a21-a43e-793ed27da421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume 36f14590-9e67-4a98-a8e0-aa7657814ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f14590-9e67-4a98-a8e0-aa7657814ba7', 'volume_size': 1} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925935543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f14590-9e67-4a98-a8e0-aa7657814ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:05Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume 36f14590-9e67-4a98-a8e0-aa7657814ba7 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:05 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:05 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 1073741824 Sep 25 12:52:05 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=142,cinder:UPDATE=181,cinder:INSERT=47,cinder:DELETE=20 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (3251f5a6-e999-4855-8a58-acffb30c6eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8774f44-205e-4e46-a54a-d26cc09028c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8774f44-205e-4e46-a54a-d26cc09028c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528345824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccde8fb8-4191-4d72-9850-559af5288e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:06Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fb2dc8-8a8b-4467-9743-6570450a4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fb2dc8-8a8b-4467-9743-6570450a4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeb2401-665c-4772-851f-229f31eb1a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efeb2401-665c-4772-851f-229f31eb1a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccde8fb8-4191-4d72-9850-559af5288e71', 'volume_name': 'volume-ccde8fb8-4191-4d72-9850-559af5288e71', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c482fa-dea6-456b-a2a3-e4640b303089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c482fa-dea6-456b-a2a3-e4640b303089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83728c54-1959-476e-bf08-3bdb862ae3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume ccde8fb8-4191-4d72-9850-559af5288e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccde8fb8-4191-4d72-9850-559af5288e71', 'volume_size': 1} Sep 25 12:52:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:06 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 1073741824" returned: 0 in 1.050s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=138,cinder:UPDATE=182,cinder:INSERT=55,cinder:DELETE=11 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:06 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 Sep 25 12:52:06 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:06 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7" returned: 0 in 0.596s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528345824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccde8fb8-4191-4d72-9850-559af5288e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:06Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume ccde8fb8-4191-4d72-9850-559af5288e71 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:06 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:06 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 1073741824 Sep 25 12:52:06 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b3ac7d-c547-4a21-a43e-793ed27da421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f14590-9e67-4a98-a8e0-aa7657814ba7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c786e1e-48a8-4a2a-b964-8a9690dc2eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 (36f14590-9e67-4a98-a8e0-aa7657814ba7): created successfully Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c786e1e-48a8-4a2a-b964-8a9690dc2eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (4db9b21d-24c1-42ad-8052-2e762c74f708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (2814dd2f-ef17-4d25-9218-8cf660e64f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d392dae3-d650-49ab-bfbd-783c0297fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (bdd3bc51-acf6-427e-a5ee-27b3773e6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8feb091e-241a-4a5f-a71a-aab03dbed6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-61b29461-2938-4eb6-977c-cf4608bc54f6 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d392dae3-d650-49ab-bfbd-783c0297fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364109956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b4af02-db1f-4567-9772-1a807c5d60ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:07Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae37604f-1284-48e9-a57d-22d47227b2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae37604f-1284-48e9-a57d-22d47227b2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0dced-61d1-455e-bd0d-a79baa9cbbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d0dced-61d1-455e-bd0d-a79baa9cbbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b4af02-db1f-4567-9772-1a807c5d60ca', 'volume_name': 'volume-71b4af02-db1f-4567-9772-1a807c5d60ca', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4030f8-2a43-4819-974b-a748056970ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4030f8-2a43-4819-974b-a748056970ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aaca34-1660-4190-90d8-b736bb150dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume 71b4af02-db1f-4567-9772-1a807c5d60ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b4af02-db1f-4567-9772-1a807c5d60ca', 'volume_size': 1} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8feb091e-241a-4a5f-a71a-aab03dbed6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1051390033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c080eacb-fe61-47e6-a5fc-0bcf99b3c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:07Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f361e3-2fa6-47d6-800d-90a3e8c833f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f361e3-2fa6-47d6-800d-90a3e8c833f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3fa240-b6c4-44ed-848b-5fd138f61880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3fa240-b6c4-44ed-848b-5fd138f61880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c080eacb-fe61-47e6-a5fc-0bcf99b3c03b', 'volume_name': 'volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde238a2-33d7-4931-944f-5ff7ccd7ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde238a2-33d7-4931-944f-5ff7ccd7ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9762790-0a1b-4bf6-9074-13fd46c8fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume c080eacb-fe61-47e6-a5fc-0bcf99b3c03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b', 'volume_size': 1} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (d07a3e1c-b053-40fa-97bb-b10e5d4f5726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c08042-fc52-4111-8bbb-bc3daaa49178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c08042-fc52-4111-8bbb-bc3daaa49178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f371b41d-6ae0-4caf-8339-d5afe5633b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:08Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55b2343-0de1-4b8e-9740-f182f183a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55b2343-0de1-4b8e-9740-f182f183a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4349fb-579f-4240-b5c5-ef9e2129bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4349fb-579f-4240-b5c5-ef9e2129bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f371b41d-6ae0-4caf-8339-d5afe5633b9d', 'volume_name': 'volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de8b8b6-7258-4d52-bc87-000db7e897a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de8b8b6-7258-4d52-bc87-000db7e897a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ee7d8b-d6d6-4391-b327-9d41340bdde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume f371b41d-6ae0-4caf-8339-d5afe5633b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d', 'volume_size': 1} Sep 25 12:52:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:08 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 1073741824" returned: 0 in 1.145s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:08 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 Sep 25 12:52:08 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:08 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71" returned: 0 in 0.443s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364109956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b4af02-db1f-4567-9772-1a807c5d60ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:07Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume 71b4af02-db1f-4567-9772-1a807c5d60ca {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:08 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83728c54-1959-476e-bf08-3bdb862ae3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccde8fb8-4191-4d72-9850-559af5288e71', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca 1073741824 Sep 25 12:52:08 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f8d61-5bbd-4152-9994-9d50c4bc8831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (3f64176b-ffd6-4ada-a647-15b94bfccd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3aa4ad-8c79-48cb-93aa-cf6eb6ddaeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-ccde8fb8-4191-4d72-9850-559af5288e71 (ccde8fb8-4191-4d72-9850-559af5288e71): created successfully Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f8d61-5bbd-4152-9994-9d50c4bc8831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (3251f5a6-e999-4855-8a58-acffb30c6eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3aa4ad-8c79-48cb-93aa-cf6eb6ddaeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1134127348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c92f4f-1107-4cda-968a-72877cf3ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:08Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a58ba-9c20-47d1-9e5b-2cf32e2aa7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a58ba-9c20-47d1-9e5b-2cf32e2aa7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c144cdf-c76b-48f3-a0e0-217cd94500de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c144cdf-c76b-48f3-a0e0-217cd94500de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c92f4f-1107-4cda-968a-72877cf3ceff', 'volume_name': 'volume-e8c92f4f-1107-4cda-968a-72877cf3ceff', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060958f7-97bd-43a4-ad1c-2805fa47f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060958f7-97bd-43a4-ad1c-2805fa47f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b26c837-e940-4ab0-96f8-ca4e97d5bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume e8c92f4f-1107-4cda-968a-72877cf3ceff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c92f4f-1107-4cda-968a-72877cf3ceff', 'volume_size': 1} Sep 25 12:52:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6fb53c0a-aa2c-4476-ad36-7f3aac459a6d tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:09 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca 1073741824" returned: 0 in 1.110s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:09 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca Sep 25 12:52:09 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:10 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca" returned: 0 in 0.465s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1051390033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c080eacb-fe61-47e6-a5fc-0bcf99b3c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:07Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:10 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aaca34-1660-4190-90d8-b736bb150dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b4af02-db1f-4567-9772-1a807c5d60ca', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:10 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b 1073741824 Sep 25 12:52:10 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9a4163-a9e1-4958-90f8-6e23b66adca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:10 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-71b4af02-db1f-4567-9772-1a807c5d60ca (71b4af02-db1f-4567-9772-1a807c5d60ca): created successfully Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9a4163-a9e1-4958-90f8-6e23b66adca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (2814dd2f-ef17-4d25-9218-8cf660e64f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9140be7b-77af-41b4-b931-760f76308f09 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:11 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b 1073741824" returned: 0 in 0.816s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:11 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b Sep 25 12:52:11 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:11 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f371b41d-6ae0-4caf-8339-d5afe5633b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:08Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume f371b41d-6ae0-4caf-8339-d5afe5633b9d {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:11 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9762790-0a1b-4bf6-9074-13fd46c8fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb71e67d-8ad0-409a-8e12-cb5b9ffb0a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:11 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d 1073741824 Sep 25 12:52:11 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:11 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b (c080eacb-fe61-47e6-a5fc-0bcf99b3c03b): created successfully Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb71e67d-8ad0-409a-8e12-cb5b9ffb0a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (bdd3bc51-acf6-427e-a5ee-27b3773e6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-207a5845-6138-4de6-b0ef-5f5b367b9551 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:12 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d 1073741824" returned: 0 in 0.728s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:12 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d Sep 25 12:52:12 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:12 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d" returned: 0 in 0.473s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.966s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1134127348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c92f4f-1107-4cda-968a-72877cf3ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6c935d10484a3faab5dcb40cfac6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:08Z,use_quota=True,user_id='e734f8cf05fc497ead3aa7e9ac148487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Creating volume e8c92f4f-1107-4cda-968a-72877cf3ceff {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:12 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ee7d8b-d6d6-4391-b327-9d41340bdde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dd791b-84be-4a53-947d-001489befe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:12 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff 1073741824 Sep 25 12:52:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d (f371b41d-6ae0-4caf-8339-d5afe5633b9d): created successfully Sep 25 12:52:12 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59dd791b-84be-4a53-947d-001489befe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (d07a3e1c-b053-40fa-97bb-b10e5d4f5726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-afa923b4-a78f-42c7-a55e-7cd11c661431 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:13 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff 1073741824" returned: 0 in 0.768s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:13 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff Sep 25 12:52:13 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:13 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff" returned: 0 in 0.358s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.367s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b26c837-e940-4ab0-96f8-ca4e97d5bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c92f4f-1107-4cda-968a-72877cf3ceff', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5f8bf5-31e7-4389-b3a9-b5d55e47cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating offline snapshot 3cafb116-79ea-459e-adcd-ecd0ac34885d of volume c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Volume volume-e8c92f4f-1107-4cda-968a-72877cf3ceff (e8c92f4f-1107-4cda-968a-72877cf3ceff): created successfully Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5f8bf5-31e7-4389-b3a9-b5d55e47cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Flow 'volume_create_manager' (3f64176b-ffd6-4ada-a647-15b94bfccd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da8eda-7193-49f6-b31c-6a566996a6ef]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f2c9f96f-1c97-4ce5-8ba4-f3a804b93bf2 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created volume successfully. Sep 25 12:52:14 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b Sep 25 12:52:14 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-e8c92f4f-1107-4cda-968a-72877cf3ceff-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-e8c92f4f-1107-4cda-968a-72877cf3ceff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-e8c92f4f-1107-4cda-968a-72877cf3ceff" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-e8c92f4f-1107-4cda-968a-72877cf3ceff" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:14 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" returned: 0 in 0.640s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff57bbc-986d-4407-99b2-7757c07a82e9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:14 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d 1G Sep 25 12:52:14 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:14 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff Sep 25 12:52:14 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff" returned: 0 in 0.624s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:15 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff Sep 25 12:52:15 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d 1G" returned: 0 in 0.754s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:15 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d Sep 25 12:52:15 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e8c92f4f-1107-4cda-968a-72877cf3ceff" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-e8c92f4f-1107-4cda-968a-72877cf3ceff" released by "delete_volume" :: held 1.227s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['e2bcec45-754b-4c18-a491-bc5f2a23bfa7', '3e169626-d2a9-45cf-9abc-bfff0179828d', 'f7ebf3af-6d2c-452e-a978-1e4c5592daae', 'aecf0aff-b80d-497c-bf8b-f3cbf868927b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:16 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d" returned: 0 in 0.644s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d is being set with open permissions: ugo+rw Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:16 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d Sep 25 12:52:16 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:16 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:16 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:16 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d" returned: 0 in 0.522s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:16 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.543s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:16 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info Sep 25 12:52:16 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dc00a2d4-f4d5-4b57-8c48-b375cfe9bec1 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-e8c92f4f-1107-4cda-968a-72877cf3ceff-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-f371b41d-6ae0-4caf-8339-d5afe5633b9d-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-f371b41d-6ae0-4caf-8339-d5afe5633b9d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-f371b41d-6ae0-4caf-8339-d5afe5633b9d" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-f371b41d-6ae0-4caf-8339-d5afe5633b9d" acquired by "delete_volume" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[51560554-9b5b-45f2-b4a3-e72ac13c5e43]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:17 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info" returned: 0 in 0.614s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:17 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info is being set with open permissions: ugo+rw Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:17 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info Sep 25 12:52:17 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:17 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d Sep 25 12:52:17 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:17 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.info" returned: 0 in 0.421s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4e3f3287-2cb6-4798-83ad-438fe74a5403 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Create snapshot completed successfully Sep 25 12:52:17 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d" returned: 0 in 0.698s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d Sep 25 12:52:18 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:18 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f371b41d-6ae0-4caf-8339-d5afe5633b9d" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-f371b41d-6ae0-4caf-8339-d5afe5633b9d" released by "delete_volume" :: held 1.383s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['4b9fc7e3-78e9-4595-a5fd-4bf99c5934d7', '339c4438-682e-4d9e-9396-32f2bd72a35a', '0b99020f-54c1-4240-9b97-178946355250', '36cfb9d2-4429-4f0e-bfdc-2f7025fbca0e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:18 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-71b4af02-db1f-4567-9772-1a807c5d60ca-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-71b4af02-db1f-4567-9772-1a807c5d60ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-71b4af02-db1f-4567-9772-1a807c5d60ca" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-71b4af02-db1f-4567-9772-1a807c5d60ca" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf98c97-550a-4835-b559-aae5a7aa79e4]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (f7d9a0fb-4b23-462c-940f-1ea913fed1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d84c31-954c-4c9f-a026-076dd1950a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d84c31-954c-4c9f-a026-076dd1950a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296475239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961127bc-d735-48ce-bed3-ad7c9ffc981c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:19Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a1975-25fe-46ba-83a1-fbc91b96af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a1975-25fe-46ba-83a1-fbc91b96af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc542b91-dc99-47c7-9806-79e2b9f117c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc542b91-dc99-47c7-9806-79e2b9f117c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961127bc-d735-48ce-bed3-ad7c9ffc981c', 'volume_name': 'volume-961127bc-d735-48ce-bed3-ad7c9ffc981c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2915ceb0-2dd1-490b-aa34-7245da5f9c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2915ceb0-2dd1-490b-aa34-7245da5f9c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ebd6d3-06f3-4430-9279-d232374a2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume 961127bc-d735-48ce-bed3-ad7c9ffc981c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961127bc-d735-48ce-bed3-ad7c9ffc981c', 'volume_size': 1} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296475239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961127bc-d735-48ce-bed3-ad7c9ffc981c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:19Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume 961127bc-d735-48ce-bed3-ad7c9ffc981c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:19 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:19 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.575s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:19 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c 1073741824 Sep 25 12:52:19 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-17caf594-4a6d-4518-958f-73c6644933f9 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-f371b41d-6ae0-4caf-8339-d5afe5633b9d-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:19 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca Sep 25 12:52:19 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:20 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (34517875-7014-40fa-9050-578e8ac8bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528300f0-7e94-417f-8b0e-9eb0933a131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca" returned: 0 in 1.013s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528300f0-7e94-417f-8b0e-9eb0933a131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-180533881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafd390d-df9f-4c46-a5cb-b33e172f137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:20Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6910ef-e004-4a2e-9ae2-003620e43cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6910ef-e004-4a2e-9ae2-003620e43cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6763d7b-807b-4e1d-8694-62fb0a1e63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:20 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca Sep 25 12:52:20 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6763d7b-807b-4e1d-8694-62fb0a1e63f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafd390d-df9f-4c46-a5cb-b33e172f137e', 'volume_name': 'volume-aafd390d-df9f-4c46-a5cb-b33e172f137e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24a963-82db-4702-812b-0ad9f41f20d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa24a963-82db-4702-812b-0ad9f41f20d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39aaf34-882c-4c89-9a40-7dc077355572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume aafd390d-df9f-4c46-a5cb-b33e172f137e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafd390d-df9f-4c46-a5cb-b33e172f137e', 'volume_size': 1} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c 1073741824" returned: 0 in 0.929s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c Sep 25 12:52:20 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-71b4af02-db1f-4567-9772-1a807c5d60ca" returned: 0 in 0.539s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-71b4af02-db1f-4567-9772-1a807c5d60ca" released by "delete_volume" :: held 1.653s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:20 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c" returned: 0 in 0.449s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-180533881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafd390d-df9f-4c46-a5cb-b33e172f137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:20Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume aafd390d-df9f-4c46-a5cb-b33e172f137e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:20 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:20 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e 1073741824 Sep 25 12:52:20 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (2440ec4a-98c3-43b8-901c-c4dc971f07be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e916bc-9382-4cc8-8b5c-a744b0adc851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e916bc-9382-4cc8-8b5c-a744b0adc851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720056288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ddb2e3-51da-422d-9932-d9a3cd06eb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:21Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6b0e5d-e3d0-489e-9973-833983cbd211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6b0e5d-e3d0-489e-9973-833983cbd211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4eead5-5dbc-4a52-89c5-8828f654dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4eead5-5dbc-4a52-89c5-8828f654dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ddb2e3-51da-422d-9932-d9a3cd06eb52', 'volume_name': 'volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfd7077-d7d1-43b1-858d-b25697cfc537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfd7077-d7d1-43b1-858d-b25697cfc537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feadcad-c19d-4afc-ad53-cbaeb09061a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume 94ddb2e3-51da-422d-9932-d9a3cd06eb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52', 'volume_size': 1} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ebd6d3-06f3-4430-9279-d232374a2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961127bc-d735-48ce-bed3-ad7c9ffc981c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51736a-3e6d-4d67-a8a3-9d6d8b00b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-961127bc-d735-48ce-bed3-ad7c9ffc981c (961127bc-d735-48ce-bed3-ad7c9ffc981c): created successfully Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51736a-3e6d-4d67-a8a3-9d6d8b00b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (f7d9a0fb-4b23-462c-940f-1ea913fed1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-79c6c495-035d-47a5-bd07-f54a22a3cd6b tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['e178ae64-a8ce-47fe-bb5e-5af003295ebc', '753a55af-1eb7-4d8b-9ab5-78568626c833', '2cbd9f48-e176-4f41-83eb-161c761f174f', '8ef51308-0abf-4112-b201-52371fcf5c17'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:21 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:21 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (fac251f7-3a82-4f20-bb39-c4887b51cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:21 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:21 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952d389-e3fb-49eb-a0f0-7ee682f93690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-ccde8fb8-4191-4d72-9850-559af5288e71-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e 1073741824" returned: 0 in 1.111s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.700s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952d389-e3fb-49eb-a0f0-7ee682f93690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735790681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23ad5eb-9a95-44fb-b221-0430bd3e9673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259a6990-6d83-4a0d-b7b8-bf4a72b6f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259a6990-6d83-4a0d-b7b8-bf4a72b6f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a464391e-32f4-4e0c-940e-edb76464e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a464391e-32f4-4e0c-940e-edb76464e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c23ad5eb-9a95-44fb-b221-0430bd3e9673', 'volume_name': 'volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b24448a-5237-4b16-90f1-2998e70ee956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b24448a-5237-4b16-90f1-2998e70ee956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae181c27-5937-459f-b310-f07a10b3717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume c23ad5eb-9a95-44fb-b221-0430bd3e9673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673', 'volume_size': 1} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-ccde8fb8-4191-4d72-9850-559af5288e71-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2e5b9fa9-e5c6-4137-a940-b145578ae14a tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-71b4af02-db1f-4567-9772-1a807c5d60ca-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:22 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e Sep 25 12:52:22 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (fd93999e-c734-4b7e-b8a0-f0faebad98af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fc9a20-3e8e-4ea4-a6d9-1083d8e9cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-ccde8fb8-4191-4d72-9850-559af5288e71" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fc9a20-3e8e-4ea4-a6d9-1083d8e9cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382963578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502c606-47ba-4eb5-bd00-b96960d3bde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c932a95-ba21-4762-8886-021b7a5a74cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c932a95-ba21-4762-8886-021b7a5a74cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051dd33-fd9e-4c94-b704-0aa9b9c3d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051dd33-fd9e-4c94-b704-0aa9b9c3d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8502c606-47ba-4eb5-bd00-b96960d3bde4', 'volume_name': 'volume-8502c606-47ba-4eb5-bd00-b96960d3bde4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcae2ba-116d-4f18-9f46-f29cc7470899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fcae2ba-116d-4f18-9f46-f29cc7470899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cb6c64-9237-49c6-b3c5-c767588b555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume 8502c606-47ba-4eb5-bd00-b96960d3bde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8502c606-47ba-4eb5-bd00-b96960d3bde4', 'volume_size': 1} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-ccde8fb8-4191-4d72-9850-559af5288e71" acquired by "delete_volume" :: waited 0.085s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd8b29e-6da8-44e6-9b6d-32f8f323dde2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (8a0d1267-f814-447a-863d-082cb98657a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d193b8e-e7a0-4f7a-b2d5-d92c59da77c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Acquiring lock "cinder-95f6568a-e8a8-40da-a0c1-5b0a41446945-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d193b8e-e7a0-4f7a-b2d5-d92c59da77c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735587711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915a7173-7db0-4df3-b35d-8fbdea52df25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4272272-d527-4164-8ed4-c625ba4a6970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4272272-d527-4164-8ed4-c625ba4a6970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd177aad-ee67-4b0c-9d81-ae00ec8595ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd177aad-ee67-4b0c-9d81-ae00ec8595ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915a7173-7db0-4df3-b35d-8fbdea52df25', 'volume_name': 'volume-915a7173-7db0-4df3-b35d-8fbdea52df25', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 Sep 25 12:52:22 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114d12d6-4df7-4851-b901-0468c33bec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114d12d6-4df7-4851-b901-0468c33bec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2c885-daf2-4818-bb38-f39980ad4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume 915a7173-7db0-4df3-b35d-8fbdea52df25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915a7173-7db0-4df3-b35d-8fbdea52df25', 'volume_size': 1} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "cinder-95f6568a-e8a8-40da-a0c1-5b0a41446945-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e" returned: 0 in 0.438s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720056288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ddb2e3-51da-422d-9932-d9a3cd06eb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:21Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume 94ddb2e3-51da-422d-9932-d9a3cd06eb52 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:22 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 1073741824 Sep 25 12:52:22 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39aaf34-882c-4c89-9a40-7dc077355572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafd390d-df9f-4c46-a5cb-b33e172f137e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b95c89-687a-4853-8e2e-6ed11f5d4ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-aafd390d-df9f-4c46-a5cb-b33e172f137e (aafd390d-df9f-4c46-a5cb-b33e172f137e): created successfully Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b95c89-687a-4853-8e2e-6ed11f5d4ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (34517875-7014-40fa-9050-578e8ac8bac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Acquiring lock "cinder-quobyte-95f6568a-e8a8-40da-a0c1-5b0a41446945" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-671ba000-5a20-49d0-838f-29d44c6af214 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "cinder-quobyte-95f6568a-e8a8-40da-a0c1-5b0a41446945" acquired by "delete_volume" :: waited 0.045s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171da08-cf60-440d-8275-db3f15d5df52]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:22 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 Sep 25 12:52:22 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71 Sep 25 12:52:23 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 1073741824" returned: 0 in 0.662s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ccde8fb8-4191-4d72-9850-559af5288e71" returned: 0 in 0.403s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-ccde8fb8-4191-4d72-9850-559af5288e71" released by "delete_volume" :: held 1.051s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:23 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 Sep 25 12:52:23 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945" returned: 0 in 0.609s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945 Sep 25 12:52:23 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['a7f05798-fae6-437a-a224-2a603b8f2a4f', '7b9447ea-718d-456c-b1a7-660a20e90378', '398be6c0-efe5-4507-8d0d-32ee7a7af817', '6dcdd5d8-e6fe-488d-9c20-a06cf1e12769'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:23 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52" returned: 0 in 0.416s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1735790681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23ad5eb-9a95-44fb-b221-0430bd3e9673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating volume c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:23 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-95f6568a-e8a8-40da-a0c1-5b0a41446945" returned: 0 in 0.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 1073741824 Sep 25 12:52:23 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "cinder-quobyte-95f6568a-e8a8-40da-a0c1-5b0a41446945" released by "delete_volume" :: held 1.061s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feadcad-c19d-4afc-ad53-cbaeb09061a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c129412-855e-4faa-8296-e5f7bb55ce55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:23 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 (94ddb2e3-51da-422d-9932-d9a3cd06eb52): created successfully Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c129412-855e-4faa-8296-e5f7bb55ce55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (2440ec4a-98c3-43b8-901c-c4dc971f07be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-61e67c4a-e050-4d7c-95b5-775756fffa82 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:23 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Created reservations ['907a8762-0b3c-4e00-92b4-b8346e0f2f63', '2032431e-8217-4a44-9dad-6780fb60ea6b', '1e7cb78c-fdde-4448-bce1-f3cfbe287f7f', 'f158cb20-1b7c-481a-b59e-0c5f0fbd9f4f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:24 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-388fc25b-c72c-4cd3-ad03-9f431eb15dc8 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-ccde8fb8-4191-4d72-9850-559af5288e71-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:24 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:24 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-36f14590-9e67-4a98-a8e0-aa7657814ba7-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-36f14590-9e67-4a98-a8e0-aa7657814ba7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:24 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.341s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Deleted volume successfully. Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-36f14590-9e67-4a98-a8e0-aa7657814ba7" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:24 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-21144e2c-ed25-4527-a9b8-01b0240cb381 tempest-VolumesNegativeTest-1772996111 None] Lock "cinder-95f6568a-e8a8-40da-a0c1-5b0a41446945-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 1073741824" returned: 0 in 0.658s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-36f14590-9e67-4a98-a8e0-aa7657814ba7" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87aa8a0-4d4b-4bf3-8686-766af375f6b6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 Sep 25 12:52:24 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 Sep 25 12:52:24 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673" returned: 0 in 0.318s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.499s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382963578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502c606-47ba-4eb5-bd00-b96960d3bde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume 8502c606-47ba-4eb5-bd00-b96960d3bde4 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:24 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae181c27-5937-459f-b310-f07a10b3717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:24 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 1073741824 Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05be2b1-3786-4ed9-b1db-deaa3112b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:24 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 (c23ad5eb-9a95-44fb-b221-0430bd3e9673): created successfully Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05be2b1-3786-4ed9-b1db-deaa3112b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (fac251f7-3a82-4f20-bb39-c4887b51cee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-48481ca2-6795-4ded-8768-cc339571c9c0 tempest-VolumesSnapshotTestJSON-1349096619 None] Created volume successfully. Sep 25 12:52:25 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7" returned: 0 in 0.567s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:25 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7 Sep 25 12:52:25 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:25 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36f14590-9e67-4a98-a8e0-aa7657814ba7" returned: 0 in 0.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-36f14590-9e67-4a98-a8e0-aa7657814ba7" released by "delete_volume" :: held 1.013s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['31ba128c-d3f8-4582-8cc7-1e30092388b7', '8e6f2c21-a7cd-4459-8386-b4ca85ec6505', '105bbb5a-fce4-4fad-b513-8e7647ba69cf', '25ffa7a5-b804-422b-9ded-3c8ed1cb12ea'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:25 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 1073741824" returned: 0 in 0.772s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:25 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:25 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:25 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 Sep 25 12:52:25 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:26 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4" returned: 0 in 0.333s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.489s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735587711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915a7173-7db0-4df3-b35d-8fbdea52df25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1969dc7cc944fe8a77fcf6e7e07c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='7893d3c234644046900ecd9efddb691a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Creating volume 915a7173-7db0-4df3-b35d-8fbdea52df25 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:26 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cb6c64-9237-49c6-b3c5-c767588b555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8502c606-47ba-4eb5-bd00-b96960d3bde4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d1de49-e8b1-4ad2-8476-c3219c05331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:26 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:26 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 1073741824 Sep 25 12:52:26 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.447s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 (8502c606-47ba-4eb5-bd00-b96960d3bde4): created successfully Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d1de49-e8b1-4ad2-8476-c3219c05331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (fd93999e-c734-4b7e-b8a0-f0faebad98af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-76a76dea-ecf0-496d-be3c-7c7e348361e1 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46ec82c4-f4e5-4623-9df8-ddf43f013f6b tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-36f14590-9e67-4a98-a8e0-aa7657814ba7-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-9db08f4e-d2ff-4f70-b285-97620c4d41f9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-9db08f4e-d2ff-4f70-b285-97620c4d41f9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "cinder-quobyte-9db08f4e-d2ff-4f70-b285-97620c4d41f9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-9db08f4e-d2ff-4f70-b285-97620c4d41f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[62046130-3b6f-4fc6-bb84-93cfbe0108b9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:27 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 1073741824" returned: 0 in 0.900s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:27 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 Sep 25 12:52:27 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:27 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 Sep 25 12:52:27 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:27 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25" returned: 0 in 0.360s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.760s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2c885-daf2-4818-bb38-f39980ad4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915a7173-7db0-4df3-b35d-8fbdea52df25', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16f42d-7d71-48b5-8384-7c9ed3353def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Creating offline snapshot b977b31a-ea68-446f-9fa1-1d255f240b99 of volume c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:27 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b9bffa-a234-4b23-ba88-6d4bb29f4e62]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:27 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Volume volume-915a7173-7db0-4df3-b35d-8fbdea52df25 (915a7173-7db0-4df3-b35d-8fbdea52df25): created successfully Sep 25 12:52:27 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9 Sep 25 12:52:27 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16f42d-7d71-48b5-8384-7c9ed3353def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Flow 'volume_create_manager' (8a0d1267-f814-447a-863d-082cb98657a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:27 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-089d6be6-f526-4d93-8379-0c6c16e46fc4 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created volume successfully. Sep 25 12:52:27 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 Sep 25 12:52:27 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:27 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9db08f4e-d2ff-4f70-b285-97620c4d41f9" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-quobyte-9db08f4e-d2ff-4f70-b285-97620c4d41f9" released by "delete_volume" :: held 0.995s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Created reservations ['dbf26633-3aa6-443c-8318-d709a929ff03', '0d90cb70-c768-4266-af45-090428d362c1', '70f211d4-ee13-43e1-ba6f-e9589275582f', '45a5b7a4-9ec4-46bf-b5f4-75b37c0e16aa'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:28 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:28 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:28 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673" returned: 0 in 0.676s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:28 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 1G Sep 25 12:52:28 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-915a7173-7db0-4df3-b35d-8fbdea52df25-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-915a7173-7db0-4df3-b35d-8fbdea52df25-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-915a7173-7db0-4df3-b35d-8fbdea52df25" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-915a7173-7db0-4df3-b35d-8fbdea52df25" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b03635-9590-42d0-acb6-a071d7b18f8d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:28 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Deleted volume successfully. Sep 25 12:52:28 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 Sep 25 12:52:28 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6e4cb89a-c090-4746-83e4-2007891de564 tempest-CreateVolumesFromSourceVolumeTest-1177748058 None] Lock "cinder-9db08f4e-d2ff-4f70-b285-97620c4d41f9-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:29 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 1G" returned: 0 in 0.757s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:29 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 Sep 25 12:52:29 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:29 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25" returned: 0 in 0.629s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:29 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25 Sep 25 12:52:29 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:29 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99" returned: 0 in 0.538s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:29 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 is being set with open permissions: ugo+rw Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:29 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 Sep 25 12:52:29 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:29 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-915a7173-7db0-4df3-b35d-8fbdea52df25" returned: 0 in 0.478s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-915a7173-7db0-4df3-b35d-8fbdea52df25" released by "delete_volume" :: held 1.181s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['758dabf2-0d68-4c4d-8f16-f023fc62138a', 'fa83417a-e57a-48d1-af2c-c8d468558131', '7f09ab0c-c4cc-4a41-86e0-c6209a6e214e', 'c1392f2b-15ed-4a4a-924e-0483145f0d96'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:29 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99" returned: 0 in 0.429s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:30 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:30 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:30 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info Sep 25 12:52:30 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:30 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.529s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f1282318-1160-42e5-8f73-e82f266d990f tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-915a7173-7db0-4df3-b35d-8fbdea52df25-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:30 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info" returned: 0 in 0.584s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:30 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info is being set with open permissions: ugo+rw Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:30 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info Sep 25 12:52:30 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-8502c606-47ba-4eb5-bd00-b96960d3bde4-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-8502c606-47ba-4eb5-bd00-b96960d3bde4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-8502c606-47ba-4eb5-bd00-b96960d3bde4" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-8502c606-47ba-4eb5-bd00-b96960d3bde4" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf4380-3ef7-47fd-8df9-09f3c71bb539]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:31 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.info" returned: 0 in 0.492s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:31 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 Sep 25 12:52:31 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.688s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-658d6cd1-1894-44b7-9a7b-69e4fd59d9da tempest-VolumesSnapshotTestJSON-1349096619 None] Create snapshot completed successfully Sep 25 12:52:31 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4" returned: 0 in 0.558s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:31 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4 Sep 25 12:52:31 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:31 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8502c606-47ba-4eb5-bd00-b96960d3bde4" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-8502c606-47ba-4eb5-bd00-b96960d3bde4" released by "delete_volume" :: held 1.101s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['3839128c-15d2-406f-ad91-ea3d46d0e133', '0141a0d0-a9c3-4bfb-8885-33b43873303b', 'f613a357-87d2-431a-9364-49875fd10754', 'd022f2c0-d9f6-4794-99d6-7d0d4b22f369'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-b977b31a-ea68-446f-9fa1-1d255f240b99-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:32 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:32 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-b977b31a-ea68-446f-9fa1-1d255f240b99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-b977b31a-ea68-446f-9fa1-1d255f240b99" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-b977b31a-ea68-446f-9fa1-1d255f240b99" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Deleting offline snapshot b977b31a-ea68-446f-9fa1-1d255f240b99 of volume c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] snapshot_file for this snap is: volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[024c4547-f11c-424d-941f-8caf43da9bb8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:32 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 Sep 25 12:52:32 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:32 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c92e00ef-0d3b-42fc-83ce-514d74dc6426 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-8502c606-47ba-4eb5-bd00-b96960d3bde4-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-94ddb2e3-51da-422d-9932-d9a3cd06eb52-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-94ddb2e3-51da-422d-9932-d9a3cd06eb52-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-94ddb2e3-51da-422d-9932-d9a3cd06eb52" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-94ddb2e3-51da-422d-9932-d9a3cd06eb52" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:33 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99" returned: 0 in 0.750s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d3d10-658c-4a92-a2ea-057b3fb00321]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad54bd-b691-4159-bfc7-733a56ffc166]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:33 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 Sep 25 12:52:33 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:33 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 Sep 25 12:52:33 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:33 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52" returned: 0 in 0.586s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52 Sep 25 12:52:34 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:34 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673" returned: 0 in 0.689s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 Sep 25 12:52:34 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:34 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-94ddb2e3-51da-422d-9932-d9a3cd06eb52" returned: 0 in 0.384s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-94ddb2e3-51da-422d-9932-d9a3cd06eb52" released by "delete_volume" :: held 1.072s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['4fedbec0-e019-4446-9225-df75cb0b4e9b', 'd044e836-09d6-494c-a5d0-0e40e1406d01', '5a7de592-ae39-4827-8719-7594ecf643ef', '821503d2-d0a7-4604-b2d8-7b237ff43109'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:34 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:34 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99" returned: 0 in 0.690s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99 Sep 25 12:52:34 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:35 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-042d5998-eee2-4400-86f5-a59487d6ab10 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-94ddb2e3-51da-422d-9932-d9a3cd06eb52-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:35 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673.b977b31a-ea68-446f-9fa1-1d255f240b99" returned: 0 in 0.535s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-b977b31a-ea68-446f-9fa1-1d255f240b99" released by "_delete_snapshot" :: held 2.870s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" released by "delete_snapshot" :: held 2.914s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['ec6fefc7-b41a-482b-b07d-940315039d85', 'ce4cd403-c4eb-4b38-a85b-61fc35f84fb0', '7a47d2da-3601-407b-be5f-a3a955ce81be', 'b1ecfdda-aa7a-4fe0-80fb-a5b61ac965ba'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-aafd390d-df9f-4c46-a5cb-b33e172f137e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-aafd390d-df9f-4c46-a5cb-b33e172f137e-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Delete snapshot completed successfully. Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77ee0d4b-993e-4a93-b174-a7bd73dac6b4 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-b977b31a-ea68-446f-9fa1-1d255f240b99-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-aafd390d-df9f-4c46-a5cb-b33e172f137e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-aafd390d-df9f-4c46-a5cb-b33e172f137e" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb694f1e-bd7f-4104-be41-196979deebd5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:36 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e Sep 25 12:52:36 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:36 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e" returned: 0 in 0.718s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:36 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e Sep 25 12:52:36 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:36 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (01ba37a0-2d94-4538-a56f-f35581f1bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36119759-646a-42fc-878d-cf3c9ae956c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36119759-646a-42fc-878d-cf3c9ae956c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1248657209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5ba89d-e134-4d61-9994-10ee1955c406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:37Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fa010b-7a81-4fb4-8933-6b965e6c0d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fa010b-7a81-4fb4-8933-6b965e6c0d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:37 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b2bd48-be86-471d-8d3c-c8fdcce7640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b2bd48-be86-471d-8d3c-c8fdcce7640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5ba89d-e134-4d61-9994-10ee1955c406', 'volume_name': 'volume-2b5ba89d-e134-4d61-9994-10ee1955c406', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e342a69-3518-437b-8c20-40aa2a73acae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e342a69-3518-437b-8c20-40aa2a73acae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07762dcd-90ed-4d28-9956-d311f1847cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Volume 2b5ba89d-e134-4d61-9994-10ee1955c406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5ba89d-e134-4d61-9994-10ee1955c406', 'volume_size': 1} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1248657209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5ba89d-e134-4d61-9994-10ee1955c406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:37Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Creating volume 2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-aafd390d-df9f-4c46-a5cb-b33e172f137e" returned: 0 in 0.552s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:37 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 1073741824 Sep 25 12:52:37 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-aafd390d-df9f-4c46-a5cb-b33e172f137e" released by "delete_volume" :: held 1.365s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['5f36c8ad-04aa-4234-9197-8db8350058b7', '1a800da0-7e3a-4c74-983d-79c492475b20', '49c48373-2c39-436e-97a2-3995e529a266', '4b1072aa-01c2-45a9-b795-873da4bcbce3'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:37 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:37 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:38 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 1073741824" returned: 0 in 0.946s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:38 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.661s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-961127bc-d735-48ce-bed3-ad7c9ffc981c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b4e2f287-6baa-4ff4-9f1f-1741498da5ec tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-aafd390d-df9f-4c46-a5cb-b33e172f137e-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:38 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:52:38 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-961127bc-d735-48ce-bed3-ad7c9ffc981c-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-961127bc-d735-48ce-bed3-ad7c9ffc981c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-961127bc-d735-48ce-bed3-ad7c9ffc981c" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fac5996-8023-4ea5-ac39-d20977de8bc8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:38 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c Sep 25 12:52:38 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:38 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.452s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07762dcd-90ed-4d28-9956-d311f1847cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5ba89d-e134-4d61-9994-10ee1955c406', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85366c2d-77d2-4734-a0c2-edcf20de7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:38 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Volume volume-2b5ba89d-e134-4d61-9994-10ee1955c406 (2b5ba89d-e134-4d61-9994-10ee1955c406): created successfully Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85366c2d-77d2-4734-a0c2-edcf20de7427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (01ba37a0-2d94-4538-a56f-f35581f1bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6a6e323a-e9dd-4d3a-b173-8714d8dbe2ca tempest-VolumesSnapshotTestJSON-1349096619 None] Created volume successfully. Sep 25 12:52:39 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c" returned: 0 in 0.687s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:39 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c Sep 25 12:52:39 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating offline snapshot f4c337fb-65bf-4c54-99db-b94e3be847af of volume 2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:39 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-961127bc-d735-48ce-bed3-ad7c9ffc981c" returned: 0 in 0.506s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b6d181-aa84-4fea-ba45-18fbb35e3390]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-961127bc-d735-48ce-bed3-ad7c9ffc981c" released by "delete_volume" :: held 1.275s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['f8284bf2-38bf-46d8-b520-c06c1b38bc06', 'e813f07d-4ff0-41ed-b512-5370c6420a48', 'dcd7c60c-49ff-4fef-af0f-80528b6a5b0c', '71f5f930-3a05-4a1f-a74f-84881ec91403'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:39 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:52:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:39 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:39 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:39 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:40 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:40 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.729s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6beb1914-b0c6-423d-b375-0f2e7d1e6dc2 tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-961127bc-d735-48ce-bed3-ad7c9ffc981c-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:40 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af 1G Sep 25 12:52:40 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-3cafb116-79ea-459e-adcd-ecd0ac34885d-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-3cafb116-79ea-459e-adcd-ecd0ac34885d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-3cafb116-79ea-459e-adcd-ecd0ac34885d" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-3cafb116-79ea-459e-adcd-ecd0ac34885d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleting offline snapshot 3cafb116-79ea-459e-adcd-ecd0ac34885d of volume c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] snapshot_file for this snap is: volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f5215-cd21-4d6a-a281-ec9de928509b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d Sep 25 12:52:41 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:41 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af 1G" returned: 0 in 0.835s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5ba89d-e134-4d61-9994-10ee1955c406 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5ba89d-e134-4d61-9994-10ee1955c406 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:52:41 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:41 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d" returned: 0 in 0.725s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[481d9442-352c-4e99-86ea-b2c6d5bd4db9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5ba89d-e134-4d61-9994-10ee1955c406 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.682s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:41 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af is being set with open permissions: ugo+rw Sep 25 12:52:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:52:41 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:41 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b Sep 25 12:52:41 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:42 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:42 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info Sep 25 12:52:42 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:42 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" returned: 0 in 0.750s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:42 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d Sep 25 12:52:42 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:42 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info" returned: 0 in 0.507s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:42 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info is being set with open permissions: ugo+rw Sep 25 12:52:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:42 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info Sep 25 12:52:42 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:43 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d" returned: 0 in 0.926s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:43 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d Sep 25 12:52:43 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:43 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.info" returned: 0 in 0.634s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:43 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d2a8ea50-5a67-455d-a1c7-69e767b2f7f6 tempest-VolumesSnapshotTestJSON-1349096619 None] Create snapshot completed successfully Sep 25 12:52:43 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b.3cafb116-79ea-459e-adcd-ecd0ac34885d" returned: 0 in 0.470s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-3cafb116-79ea-459e-adcd-ecd0ac34885d" released by "_delete_snapshot" :: held 3.129s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" released by "delete_snapshot" :: held 3.171s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['3e098218-d718-448d-9e8e-372e61ef5f43', 'cc6122cc-c874-4724-b05a-daab21186a7f', '7d4c05c4-d9a7-4656-8128-8ff4962d78a6', '0a28614f-f3e7-436d-826a-656ecc84acbb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Delete snapshot completed successfully. Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4ef589c7-b6a0-4337-9799-56e665e08b5a tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-3cafb116-79ea-459e-adcd-ecd0ac34885d-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (c8645a62-2241-418e-82b4-34309997f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d27959-a738-4e1c-8456-625176786be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d27959-a738-4e1c-8456-625176786be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-259022066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145a5fff-f8f8-4314-a8a8-5a02eecbe50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f4c337fb-65bf-4c54-99db-b94e3be847af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:45Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a13f829-132c-460f-a045-b42123b19391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a13f829-132c-460f-a045-b42123b19391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a67ec-d95d-4077-b0e9-455d103406da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a67ec-d95d-4077-b0e9-455d103406da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '145a5fff-f8f8-4314-a8a8-5a02eecbe50e', 'volume_name': 'volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e', 'volume_size': 2, 'snapshot_id': 'f4c337fb-65bf-4c54-99db-b94e3be847af'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae382c5c-9e7c-4747-9a14-647ffb7680d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae382c5c-9e7c-4747-9a14-647ffb7680d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f8d244-067f-43bf-80a9-14a74dcde768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:44 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume 145a5fff-f8f8-4314-a8a8-5a02eecbe50e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e', 'volume_size': 2, 'snapshot_id': 'f4c337fb-65bf-4c54-99db-b94e3be847af'} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating volume 145a5fff-f8f8-4314-a8a8-5a02eecbe50e from snapshot f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] snapshot: f4c337fb-65bf-4c54-99db-b94e3be847af, volume: 145a5fff-f8f8-4314-a8a8-5a02eecbe50e, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9fa83-605b-4906-943d-5ce20ab8c991]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:45 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:52:45 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac50b8-2014-45d5-9950-16541119f5cb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:45 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b Sep 25 12:52:45 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:45 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.730s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b5ba89d-e134-4d61-9994-10ee1955c406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[38357020-da63-4a1b-b928-61b96484a37a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:46 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:52:46 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:46 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" returned: 0 in 0.687s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:46 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b Sep 25 12:52:46 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:46 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.729s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:46 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" returned: 0 in 0.515s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:46 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e Sep 25 12:52:46 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-quobyte-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b" released by "delete_volume" :: held 1.317s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Created reservations ['48d1b097-f266-468f-9441-eaa308f61a92', '5c8b7a27-7a35-4ee8-9127-c046c89921f6', '8b106efc-6474-4ff6-8c50-a9c33f92f198', 'edfffcf0-b392-43f3-81ba-9725aca57d6c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:47 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:47 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:47 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:47 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:47 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.464s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Deleted volume successfully. Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46c0791a-ffae-45b7-8e3a-20db4da5828c tempest-CreateVolumesFromSnapshotTest-2040782196 None] Lock "cinder-c080eacb-fe61-47e6-a5fc-0bcf99b3c03b-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:47 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:52:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Flow 'volume_create_manager' (809bfbca-6e25-4ac1-a6fd-28e342821c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71959199-923d-430a-8de4-72fcf0a30bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71959199-923d-430a-8de4-72fcf0a30bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772087497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7ebf8-c702-4a12-b7d8-b9262d9c4446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5732028c7949a8887d78194ea96a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:56Z,use_quota=True,user_id='543ca56bc8044351902fad5579603e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e41722-556d-474e-9cee-a7d656f27a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:55 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e41722-556d-474e-9cee-a7d656f27a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25edeeed-9fe7-4306-9402-9e083a28a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25edeeed-9fe7-4306-9402-9e083a28a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b7ebf8-c702-4a12-b7d8-b9262d9c4446', 'volume_name': 'volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c805be5d-a31d-410c-82e6-1a7ddc4a3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c805be5d-a31d-410c-82e6-1a7ddc4a3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416d4d7e-7166-4c1d-8899-5cf57b829819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Volume b6b7ebf8-c702-4a12-b7d8-b9262d9c4446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446', 'volume_size': 1} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:56 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" returned: 0 in 9.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:52:56 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Converted 1024.00 MB image at 108.47 MB/s Sep 25 12:52:56 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e is being set with open permissions: ugo+rw Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:56 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e Sep 25 12:52:56 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:56 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" returned: 0 in 0.300s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" released by "_copy_volume_from_snapshot" :: held 11.366s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" released by "_create_volume_from_snapshot" :: held 11.492s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.527s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772087497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7ebf8-c702-4a12-b7d8-b9262d9c4446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5732028c7949a8887d78194ea96a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:56Z,use_quota=True,user_id='543ca56bc8044351902fad5579603e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Creating volume b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:56 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 1073741824 Sep 25 12:52:56 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f8d244-067f-43bf-80a9-14a74dcde768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e', 'volume_size': 2, 'snapshot_id': 'f4c337fb-65bf-4c54-99db-b94e3be847af'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cd1515-6966-48a7-a69e-a60e0d9c6a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e (145a5fff-f8f8-4314-a8a8-5a02eecbe50e): created successfully Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cd1515-6966-48a7-a69e-a60e0d9c6a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (c8645a62-2241-418e-82b4-34309997f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-47a15479-d827-4632-b624-8561cea16759 tempest-VolumesSnapshotTestJSON-1349096619 None] Created volume successfully. Sep 25 12:52:57 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 1073741824" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:57 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:52:57 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-145a5fff-f8f8-4314-a8a8-5a02eecbe50e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:57 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.324s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-145a5fff-f8f8-4314-a8a8-5a02eecbe50e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416d4d7e-7166-4c1d-8899-5cf57b829819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35db5603-dab7-4b3e-baa6-79b74fef2ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Volume volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 (b6b7ebf8-c702-4a12-b7d8-b9262d9c4446): created successfully Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35db5603-dab7-4b3e-baa6-79b74fef2ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Flow 'volume_create_manager' (809bfbca-6e25-4ac1-a6fd-28e342821c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7497f03c-395e-49a8-8a54-78b39bc8a96e tempest-VolumeDependencyTests-396879636 None] Created volume successfully. Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[474cb995-c263-4ba2-959a-fca3ce994194]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:57 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e Sep 25 12:52:57 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Creating offline snapshot 78585950-2071-4f42-93a6-9f23ca5dd68a of volume b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49036c1-fea0-4394-a8cd-eb999b3ad179]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:58 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" returned: 0 in 0.637s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:58 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e Sep 25 12:52:58 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:58 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:52:58 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:58 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" returned: 0 in 0.427s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-145a5fff-f8f8-4314-a8a8-5a02eecbe50e" released by "delete_volume" :: held 1.163s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:58 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.538s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:58 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a 1G Sep 25 12:52:58 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['bdf2f173-476e-4028-b05a-a84aa0e68937', '4d53e136-cfbb-4284-935a-f1ec7c87d0a0', 'fbd61eb5-7039-4e2b-b2b0-b5dd8e54318f', 'a8d17983-0245-4a04-a239-2d74a9a00947'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:59 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:52:59 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:59 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.421s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Deleted volume successfully. Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2abde9f4-09a5-494b-b269-df979d088cdb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-145a5fff-f8f8-4314-a8a8-5a02eecbe50e-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:59 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a 1G" returned: 0 in 0.711s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:59 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:52:59 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-f4c337fb-65bf-4c54-99db-b94e3be847af-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-f4c337fb-65bf-4c54-99db-b94e3be847af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:59 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.495s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a is being set with open permissions: ugo+rw Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Deleting offline snapshot f4c337fb-65bf-4c54-99db-b94e3be847af of volume 2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:53:00 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:53:00 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] snapshot_file for this snap is: volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d5d961-6beb-4e0f-84f6-3f582df09ea5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:53:00 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:00 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.382s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info Sep 25 12:53:00 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:00 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.565s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b5ba89d-e134-4d61-9994-10ee1955c406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[71934414-e078-4f38-98e8-2e1c00f7deb5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info" returned: 0 in 0.430s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info is being set with open permissions: ugo+rw Sep 25 12:53:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info Sep 25 12:53:00 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:53:00 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:00 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:01 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.info" returned: 0 in 0.442s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f3b06eee-41d1-4a25-bf78-25e854017bc9 tempest-VolumeDependencyTests-396879636 None] Create snapshot completed successfully Sep 25 12:53:01 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.823s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:01 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:53:01 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:01 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:02 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af Sep 25 12:53:02 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:02 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406.f4c337fb-65bf-4c54-99db-b94e3be847af" returned: 0 in 0.306s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-f4c337fb-65bf-4c54-99db-b94e3be847af" released by "_delete_snapshot" :: held 2.268s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" released by "delete_snapshot" :: held 2.311s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:02 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['27074b66-816d-4c50-9b2d-6ec5006937e3', '10634dea-28a1-40b5-bd57-7c0244d07939', 'ef0500e3-26ba-4b36-bf5e-cbaddf7e8b5a', '7fa03ff7-8576-4c31-9b14-2286e3182513'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Delete snapshot completed successfully. Sep 25 12:53:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b9a6abbf-eca7-434b-b9e1-5e0decc3f644 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-f4c337fb-65bf-4c54-99db-b94e3be847af-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-2b5ba89d-e134-4d61-9994-10ee1955c406-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Flow 'volume_create_manager' (53feca0c-bbef-4568-92af-fb70da656e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e8a872-7f71-4bce-9878-36c31b508b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e8a872-7f71-4bce-9878-36c31b508b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1398523154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991a8591-03aa-48d5-ab25-00622009bac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5732028c7949a8887d78194ea96a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78585950-2071-4f42-93a6-9f23ca5dd68a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:03Z,use_quota=True,user_id='543ca56bc8044351902fad5579603e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82327274-6304-4c61-b46c-52c5d8884a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82327274-6304-4c61-b46c-52c5d8884a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1ad9ba-f7f1-4d6a-90dd-185ab4ed8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1ad9ba-f7f1-4d6a-90dd-185ab4ed8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '991a8591-03aa-48d5-ab25-00622009bac6', 'volume_name': 'volume-991a8591-03aa-48d5-ab25-00622009bac6', 'volume_size': 1, 'snapshot_id': '78585950-2071-4f42-93a6-9f23ca5dd68a'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591eb34-df95-4374-9bea-9f82dfc74701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591eb34-df95-4374-9bea-9f82dfc74701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609285e1-8395-49bd-ae34-8eec2f2ed173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:03 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Volume 991a8591-03aa-48d5-ab25-00622009bac6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-991a8591-03aa-48d5-ab25-00622009bac6', 'volume_size': 1, 'snapshot_id': '78585950-2071-4f42-93a6-9f23ca5dd68a'} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-2b5ba89d-e134-4d61-9994-10ee1955c406-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a-991a8591-03aa-48d5-ab25-00622009bac6" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a-991a8591-03aa-48d5-ab25-00622009bac6" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Creating volume 991a8591-03aa-48d5-ab25-00622009bac6 from snapshot 78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] snapshot: 78585950-2071-4f42-93a6-9f23ca5dd68a, volume: 991a8591-03aa-48d5-ab25-00622009bac6, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0e27a-58cb-4eaf-9513-dede3505b668]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d659a-3e88-444f-815b-7a70f4d2da48]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:03 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:53:03 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:03 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:53:03 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:04 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.543s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:04 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.536s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:04 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406 Sep 25 12:53:04 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b9b957-c980-44f9-bdaf-8c2d476c379b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:04 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:53:04 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:04 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2b5ba89d-e134-4d61-9994-10ee1955c406" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-2b5ba89d-e134-4d61-9994-10ee1955c406" released by "delete_volume" :: held 0.968s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['2e0fff2c-c393-41ee-a1a5-3247025e669b', 'fa6a93ab-e5da-4c47-8ba2-0c7e3ac0a239', 'a6959281-1cd8-444a-82ec-167c7a8cbaf2', '1b8bf152-976f-46cc-b1b1-ad0f6245f338'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:04 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.470s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:04 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 Sep 25 12:53:04 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:04 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:04 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:05 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.320s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:05 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Deleted volume successfully. Sep 25 12:53:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-eb22d86f-0570-40cc-a346-faa06f7b2918 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-2b5ba89d-e134-4d61-9994-10ee1955c406-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:06 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=141,cinder:INSERT=44,cinder:UPDATE=185,cinder:DELETE=21 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:06 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=190,cinder:SELECT=146,cinder:INSERT=47,cinder:DELETE=13 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (7097d46c-c1b5-4cce-9047-b8ce2e1f05a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec335e1e-ffb8-4b2a-a2c2-77251321b800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec335e1e-ffb8-4b2a-a2c2-77251321b800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145088962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f2247f-9459-43c5-a1b5-e6b53b56f472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:07Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74da04fa-60b2-43a1-8b3c-36759cb8f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74da04fa-60b2-43a1-8b3c-36759cb8f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fff924-82f0-4036-83ad-52e5685f85ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fff924-82f0-4036-83ad-52e5685f85ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f2247f-9459-43c5-a1b5-e6b53b56f472', 'volume_name': 'volume-49f2247f-9459-43c5-a1b5-e6b53b56f472', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9060e516-a43d-452a-996b-970d17813bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9060e516-a43d-452a-996b-970d17813bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633dd7e-06d5-4579-ad57-0f54f682ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume 49f2247f-9459-43c5-a1b5-e6b53b56f472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f2247f-9459-43c5-a1b5-e6b53b56f472', 'volume_size': 1} Sep 25 12:53:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Flow 'volume_create_manager' (9e9132a2-471f-4fad-9de7-d69a043987b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af00d9-49b2-4fa4-b403-d4a51f19334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af00d9-49b2-4fa4-b403-d4a51f19334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-839260695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54e5343-c722-4e89-9224-235586c9a468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d77a9cc31242648b2d2326f2eaed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:11Z,use_quota=True,user_id='8a7a5c472c7f4fe48517a738b73b59b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63b137c-5602-4f57-b8be-bb2277a800aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63b137c-5602-4f57-b8be-bb2277a800aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa4f08-f24e-4fce-b6a5-03a1b521f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:11 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:53:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa4f08-f24e-4fce-b6a5-03a1b521f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f54e5343-c722-4e89-9224-235586c9a468', 'volume_name': 'volume-f54e5343-c722-4e89-9224-235586c9a468', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23ac02-6bb5-4245-b1b3-64b0763bc40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23ac02-6bb5-4245-b1b3-64b0763bc40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f81a32-1b1d-4f11-8e12-2f08b0f2fa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Volume f54e5343-c722-4e89-9224-235586c9a468: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f54e5343-c722-4e89-9224-235586c9a468', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:53:12 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Trying to clone f54e5343-c722-4e89-9224-235586c9a468 from image d090291b-21f1-4593-a719-dd6e6ea3f284 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:53:13 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d56738-4256-44f4-b772-4f182902342a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:13 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6" returned: 0 in 8.479s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:53:13 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Converted 1024.00 MB image at 120.74 MB/s Sep 25 12:53:13 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 is being set with open permissions: ugo+rw Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:13 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 Sep 25 12:53:13 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:13 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD Sep 25 12:53:13 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:13 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6" returned: 0 in 0.295s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" released by "_copy_volume_from_snapshot" :: held 9.943s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:13 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a-991a8591-03aa-48d5-ab25-00622009bac6" released by "_create_volume_from_snapshot" :: held 10.034s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.090s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.453s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145088962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f2247f-9459-43c5-a1b5-e6b53b56f472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:07Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating volume 49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:13 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 is fetched for user 8a7a5c472c7f4fe48517a738b73b59b9. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:53:13 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 1073741824 Sep 25 12:53:13 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609285e1-8395-49bd-ae34-8eec2f2ed173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991a8591-03aa-48d5-ab25-00622009bac6', 'volume_size': 1, 'snapshot_id': '78585950-2071-4f42-93a6-9f23ca5dd68a'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a7c30e-2658-46d9-8153-1e57c1c3e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Volume volume-991a8591-03aa-48d5-ab25-00622009bac6 (991a8591-03aa-48d5-ab25-00622009bac6): created successfully Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a7c30e-2658-46d9-8153-1e57c1c3e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Flow 'volume_create_manager' (53feca0c-bbef-4568-92af-fb70da656e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3fe4da76-9089-40f2-b576-ccd386ec1b2f tempest-VolumeDependencyTests-396879636 None] Created volume successfully. Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be9121-1a3a-4c36-83c7-84960443a5dd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:13 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD Sep 25 12:53:13 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:14 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 1073741824" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:14 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:14 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:14 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-78585950-2071-4f42-93a6-9f23ca5dd68a-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:14 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-78585950-2071-4f42-93a6-9f23ca5dd68a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.375s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-839260695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54e5343-c722-4e89-9224-235586c9a468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d77a9cc31242648b2d2326f2eaed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:11Z,use_quota=True,user_id='8a7a5c472c7f4fe48517a738b73b59b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Creating volume f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:14 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:14 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1073741824 Sep 25 12:53:14 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633dd7e-06d5-4579-ad57-0f54f682ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f2247f-9459-43c5-a1b5-e6b53b56f472', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a8191a-be3f-4150-ad84-dca609b92443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Deleting offline snapshot 78585950-2071-4f42-93a6-9f23ca5dd68a of volume b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] snapshot_file for this snap is: volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:53:14 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 (49f2247f-9459-43c5-a1b5-e6b53b56f472): created successfully Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a8191a-be3f-4150-ad84-dca609b92443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (7097d46c-c1b5-4cce-9047-b8ce2e1f05a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bee50a-a09c-4c07-bea6-60a5ea2fbd96]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-af0c100b-4de6-48c7-a649-d781bf2a3118 tempest-VolumesSnapshotTestJSON-1349096619 None] Created volume successfully. Sep 25 12:53:14 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:53:14 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:15 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1073741824" returned: 0 in 0.519s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 Sep 25 12:53:15 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:15 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.490s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272279f-31f4-44f9-9bbe-5fd97d25911e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:53:15 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:15 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468" returned: 0 in 0.289s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Attempting download of d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume f54e5343-c722-4e89-9224-235586c9a468. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1d1b76-98fa-4ffe-930c-0f3b12257a4e]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg Sep 25 12:53:15 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:15 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.679s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating offline snapshot 60e15f63-c86e-46b0-8028-12abfb6bb16c of volume 49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:53:15 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:53:15 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:15 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg" returned: 0 in 0.409s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dffc2d-7c1a-457d-a764-6874fa68b130]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:15 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg Sep 25 12:53:15 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:16 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg" returned: 1 in 0.362s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d090291b-21f1-4593-a719-dd6e6ea3f284_7hkvk9gg' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e2e1f-6f81-4a92-8b39-4b551ee91bd6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:16 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.427s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:16 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a Sep 25 12:53:16 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD Sep 25 12:53:16 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.477s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:16 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c 1G Sep 25 12:53:16 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446.78585950-2071-4f42-93a6-9f23ca5dd68a" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] d090291b-21f1-4593-a719-dd6e6ea3f284 was qcow2, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-78585950-2071-4f42-93a6-9f23ca5dd68a" released by "_delete_snapshot" :: held 2.104s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" released by "delete_snapshot" :: held 2.157s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:16 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 Sep 25 12:53:16 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Created reservations ['f21f25f3-2757-48bf-994c-4697dca41648', '62b0fcbf-6db1-48db-9f54-c60ccb7af85c', '7a321323-4aeb-493d-8b38-0f0f7bb7405e', '427f1139-e353-47ed-b577-c89e64cea260'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Delete snapshot completed successfully. Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b437878d-9919-4ec6-828c-a13be1e44b01 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-78585950-2071-4f42-93a6-9f23ca5dd68a-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:16 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c 1G" returned: 0 in 0.596s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:16 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:16 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:17 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.396s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:17 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c is being set with open permissions: ugo+rw Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:17 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:17 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:17 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.414s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:17 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info Sep 25 12:53:17 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[af162745-13ac-4d4e-83ac-9ffb418773f9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:18 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:53:18 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:18 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info" returned: 0 in 0.388s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:18 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info is being set with open permissions: ugo+rw Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:18 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info Sep 25 12:53:18 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:18 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.515s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:18 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446 Sep 25 12:53:18 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:18 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.info" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f4af632d-b9d5-4542-864b-0ef97eb4c275 tempest-VolumesSnapshotTestJSON-1349096619 None] Create snapshot completed successfully Sep 25 12:53:18 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446" released by "delete_volume" :: held 1.001s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Created reservations ['ccc5b2e1-8646-411a-87e1-d8faaffd88e0', 'c86817e0-7a84-41ae-9afb-1477e8e4fcc1', '142e4875-f9e8-4cb9-b3e4-14ba8ef08482', '43fa7d97-e062-4de9-ac16-130f0b32c4b7'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:19 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468" returned: 0 in 2.553s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d090291b-21f1-4593-a719-dd6e6ea3f284_r_o1ml0wdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:53:19 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Converted 112.00 MB image at 43.81 MB/s Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:19 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:19 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:19 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1G Sep 25 12:53:19 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:19 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.317s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Deleted volume successfully. Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f3ba3c88-6498-4544-a7c7-ba3290487c26 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-b6b7ebf8-c702-4a12-b7d8-b9262d9c4446-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:19 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 1G" returned: 0 in 0.507s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Downloaded image d090291b-21f1-4593-a719-dd6e6ea3f284 ((None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}])) to volume f54e5343-c722-4e89-9224-235586c9a468 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Temporary image d090291b-21f1-4593-a719-dd6e6ea3f284 for user 8a7a5c472c7f4fe48517a738b73b59b9 is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Marking volume f54e5343-c722-4e89-9224-235586c9a468 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Copying metadata from image d090291b-21f1-4593-a719-dd6e6ea3f284 to f54e5343-c722-4e89-9224-235586c9a468. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Creating volume glance metadata for volume f54e5343-c722-4e89-9224-235586c9a468 backed by image d090291b-21f1-4593-a719-dd6e6ea3f284 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f81a32-1b1d-4f11-8e12-2f08b0f2fa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54e5343-c722-4e89-9224-235586c9a468', 'volume_size': 1, 'image_id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d090291b-21f1-4593-a719-dd6e6ea3f284', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2986e5a8190341c2835457333dfddce7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd090291b-21f1-4593-a719-dd6e6ea3f284', 'created_at': datetime.datetime(2026, 9, 25, 10, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d090291b-21f1-4593-a719-dd6e6ea3f284/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82ec82c-6140-424d-a78e-6ad6a43cac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (5a071888-bd06-453a-a6e4-6bc41c269c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5916cb13-85e7-423a-9e2b-b2af099856c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Volume volume-f54e5343-c722-4e89-9224-235586c9a468 (f54e5343-c722-4e89-9224-235586c9a468): created successfully Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82ec82c-6140-424d-a78e-6ad6a43cac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Flow 'volume_create_manager' (9e9132a2-471f-4fad-9de7-d69a043987b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5916cb13-85e7-423a-9e2b-b2af099856c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-875991243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e7ca33-f289-4ed9-9dd9-808a0087f8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092eafd20125410c8fef9df370d8adad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60e15f63-c86e-46b0-8028-12abfb6bb16c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:20Z,use_quota=True,user_id='78d397e605c041009d3b5926b343a162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836c6a7-c37a-4597-bc81-c5a7b65b0492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e836c6a7-c37a-4597-bc81-c5a7b65b0492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5704e5e-861e-4fe7-bdd4-9d1e79e0eca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5704e5e-861e-4fe7-bdd4-9d1e79e0eca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27e7ca33-f289-4ed9-9dd9-808a0087f8e1', 'volume_name': 'volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1', 'volume_size': 1, 'snapshot_id': '60e15f63-c86e-46b0-8028-12abfb6bb16c'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bba5132-4bf6-442d-9c0d-452534793a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bba5132-4bf6-442d-9c0d-452534793a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa39796-b60f-4e77-a2b3-8f7c70f722a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume 27e7ca33-f289-4ed9-9dd9-808a0087f8e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1', 'volume_size': 1, 'snapshot_id': '60e15f63-c86e-46b0-8028-12abfb6bb16c'} Sep 25 12:53:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4c40ff9d-e23a-4a3a-bbba-44b07c96d1ec tempest-TestShelveInstance-87718229 None] Created volume successfully. Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating volume 27e7ca33-f289-4ed9-9dd9-808a0087f8e1 from snapshot 60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-991a8591-03aa-48d5-ab25-00622009bac6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] snapshot: 60e15f63-c86e-46b0-8028-12abfb6bb16c, volume: 27e7ca33-f289-4ed9-9dd9-808a0087f8e1, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-991a8591-03aa-48d5-ab25-00622009bac6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a4b2e-9f36-4b9e-8cad-9296c8dfccd2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[190a3c99-49ee-4398-8f35-e23edcd981a3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:20 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:20 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:20 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 Sep 25 12:53:20 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:20 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.467s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49f2247f-9459-43c5-a1b5-e6b53b56f472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b6c79-f848-4d5a-9e43-b03cef73ce38]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:20 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:20 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:20 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:20 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6 Sep 25 12:53:20 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:21 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-991a8591-03aa-48d5-ab25-00622009bac6" returned: 0 in 0.328s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-quobyte-991a8591-03aa-48d5-ab25-00622009bac6" released by "delete_volume" :: held 0.950s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:21 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Created reservations ['e2276942-e585-4b35-9359-fd13b062921f', '6605aa82-58c8-4fea-88be-731f3383214d', '27d43a99-4bd1-466e-831f-7d6c5accf33f', '0b445ad3-2e74-42f6-94bb-e3eea9a33965'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:21 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 Sep 25 12:53:21 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:21 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:21 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:21 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.330s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Deleted volume successfully. Sep 25 12:53:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-54ddd6cb-fafa-4e37-8989-fbcc414abd24 tempest-VolumeDependencyTests-396879636 None] Lock "cinder-991a8591-03aa-48d5-ab25-00622009bac6-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c2002b34-482a-4549-8d5a-0d43b4cfcdbc req-754f5948-0553-45e9-926b-3a1e7eb7d2a1 tempest-TestShelveInstance-87718229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Flow 'volume_create_manager' (09a320a1-f01b-4399-b65c-595116c9b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb8bcf1-10b9-45de-8bb6-417ce623ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:30 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" returned: 0 in 9.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472, size 1024.00 MB, duration 9.58 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:53:30 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Converted 1024.00 MB image at 106.89 MB/s Sep 25 12:53:30 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 is being set with open permissions: ugo+rw Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb8bcf1-10b9-45de-8bb6-417ce623ac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b7e5d1-6a25-4994-b023-42f4afc845f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6144a2d85a2542018ebd10f2468cd870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:31Z,use_quota=True,user_id='2eddbdf5757949d8b427aadc4138a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34644a3b-fbc3-4c3a-b4b1-6c4f110de7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:30 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 Sep 25 12:53:30 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34644a3b-fbc3-4c3a-b4b1-6c4f110de7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a35943d-b57a-4d66-a303-5cb2fa26c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a35943d-b57a-4d66-a303-5cb2fa26c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b7e5d1-6a25-4994-b023-42f4afc845f5', 'volume_name': 'volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ab8d2-93b0-4108-a560-eee811ceaef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ab8d2-93b0-4108-a560-eee811ceaef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d284bb30-a7c7-4ea5-8df9-ad1b08be5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Volume b1b7e5d1-6a25-4994-b023-42f4afc845f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5', 'volume_size': 1} Sep 25 12:53:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:31 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" released by "_copy_volume_from_snapshot" :: held 11.085s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" released by "_create_volume_from_snapshot" :: held 11.207s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.236s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c2002b34-482a-4549-8d5a-0d43b4cfcdbc req-754f5948-0553-45e9-926b-3a1e7eb7d2a1 tempest-TestShelveInstance-87718229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.203s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-c2002b34-482a-4549-8d5a-0d43b4cfcdbc req-754f5948-0553-45e9-926b-3a1e7eb7d2a1 tempest-TestShelveInstance-87718229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b7e5d1-6a25-4994-b023-42f4afc845f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6144a2d85a2542018ebd10f2468cd870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:31Z,use_quota=True,user_id='2eddbdf5757949d8b427aadc4138a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Creating volume b1b7e5d1-6a25-4994-b023-42f4afc845f5 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:31 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa39796-b60f-4e77-a2b3-8f7c70f722a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1', 'volume_size': 1, 'snapshot_id': '60e15f63-c86e-46b0-8028-12abfb6bb16c'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:31 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 1073741824 Sep 25 12:53:31 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1889e7f-749f-4c9b-ad61-ac7086813688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Volume volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 (27e7ca33-f289-4ed9-9dd9-808a0087f8e1): created successfully Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1889e7f-749f-4c9b-ad61-ac7086813688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Flow 'volume_create_manager' (5a071888-bd06-453a-a6e4-6bc41c269c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0149aa0d-0ffb-4865-bb83-6e4833fe54a6 tempest-VolumesSnapshotTestJSON-1349096619 None] Created volume successfully. Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-c2002b34-482a-4549-8d5a-0d43b4cfcdbc req-754f5948-0553-45e9-926b-3a1e7eb7d2a1 tempest-TestShelveInstance-87718229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-f54e5343-c722-4e89-9224-235586c9a468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e67c7d-12be-400d-893d-a12c1424f970', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:53:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-c2002b34-482a-4549-8d5a-0d43b4cfcdbc req-754f5948-0553-45e9-926b-3a1e7eb7d2a1 tempest-TestShelveInstance-87718229 None] attachment_update completed successfully. Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-27e7ca33-f289-4ed9-9dd9-808a0087f8e1-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-27e7ca33-f289-4ed9-9dd9-808a0087f8e1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d9324-c7e4-43bd-be58-ce1360cb7610]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:32 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 Sep 25 12:53:32 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:32 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 1073741824" returned: 0 in 1.086s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:32 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 Sep 25 12:53:32 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:32 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" returned: 0 in 0.744s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:32 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1 Sep 25 12:53:32 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:33 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5" returned: 0 in 0.560s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d284bb30-a7c7-4ea5-8df9-ad1b08be5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e050ccc-9d57-457b-b1d5-708cf707ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Volume volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 (b1b7e5d1-6a25-4994-b023-42f4afc845f5): created successfully Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e050ccc-9d57-457b-b1d5-708cf707ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Flow 'volume_create_manager' (09a320a1-f01b-4399-b65c-595116c9b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:33 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-79cc7c79-7940-4f04-84f5-b52fec03fc7b tempest-CinderUnicodeTest-1822397577 None] Created volume successfully. Sep 25 12:53:33 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" returned: 0 in 0.514s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-27e7ca33-f289-4ed9-9dd9-808a0087f8e1" released by "delete_volume" :: held 1.359s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['a2c8f816-4ac6-411b-80b0-f27c8be785fb', '41f1caf9-93c8-4f8d-98d2-0dbaad99aeac', '807924bf-9aa7-4767-b20a-61b0131cdf50', '27ee6794-b3b9-4993-a3fb-c699a1898635'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:33 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:33 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:34 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.626s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Deleted volume successfully. Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7af6da8e-3f87-4314-a652-6b45473420bb tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-27e7ca33-f289-4ed9-9dd9-808a0087f8e1-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-60e15f63-c86e-46b0-8028-12abfb6bb16c-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-60e15f63-c86e-46b0-8028-12abfb6bb16c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Deleting offline snapshot 60e15f63-c86e-46b0-8028-12abfb6bb16c of volume 49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] snapshot_file for this snap is: volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d2df5-99f0-4372-bae6-11aee65ccfdc]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:35 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:35 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:35 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Flow 'volume_create_manager' (9d25b95b-390b-4788-81ab-85c217ab8629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395bd55c-9ecc-46da-8dc5-b5253f6adea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.937s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49f2247f-9459-43c5-a1b5-e6b53b56f472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395bd55c-9ecc-46da-8dc5-b5253f6adea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991450100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57f8f93-cce1-48a8-bda5-1e4a8b45dc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6144a2d85a2542018ebd10f2468cd870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:36Z,use_quota=True,user_id='2eddbdf5757949d8b427aadc4138a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e674f-c788-4597-8e3b-6b708a04dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e674f-c788-4597-8e3b-6b708a04dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d35f184-4b12-43e3-b4d3-8becb0899aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d35f184-4b12-43e3-b4d3-8becb0899aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57f8f93-cce1-48a8-bda5-1e4a8b45dc18', 'volume_name': 'volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e5a86a-1ec8-4521-88df-788e0b46f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e5a86a-1ec8-4521-88df-788e0b46f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f3ba2-5d04-4edf-a2ef-defda101049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Volume f57f8f93-cce1-48a8-bda5-1e4a8b45dc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18', 'volume_size': 1} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991450100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57f8f93-cce1-48a8-bda5-1e4a8b45dc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6144a2d85a2542018ebd10f2468cd870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:36Z,use_quota=True,user_id='2eddbdf5757949d8b427aadc4138a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Creating volume f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:35 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbde37f-c1bc-4221-88be-095100b2f17e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:36 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 1073741824 Sep 25 12:53:36 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:36 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:36 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:36 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 1073741824" returned: 0 in 0.731s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:36 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 Sep 25 12:53:36 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:36 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.879s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:36 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:36 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:37 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" returned: 0 in 0.338s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f3ba2-5d04-4edf-a2ef-defda101049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3624b76-2bba-43d3-8114-30404b3e040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Volume volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 (f57f8f93-cce1-48a8-bda5-1e4a8b45dc18): created successfully Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3624b76-2bba-43d3-8114-30404b3e040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Flow 'volume_create_manager' (9d25b95b-390b-4788-81ab-85c217ab8629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bb4afb9f-665f-4fec-8caf-a4c6039bc356 tempest-CinderUnicodeTest-1822397577 None] Created volume successfully. Sep 25 12:53:37 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.576s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:37 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c Sep 25 12:53:37 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:37 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472.60e15f63-c86e-46b0-8028-12abfb6bb16c" returned: 0 in 0.331s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-60e15f63-c86e-46b0-8028-12abfb6bb16c" released by "_delete_snapshot" :: held 3.062s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" released by "delete_snapshot" :: held 3.122s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['b51f4618-331e-4f25-9301-3e1e296bbc4a', 'ae993d4f-398c-4726-af89-aa3d4ff11636', '8086e2f1-bd76-41b9-bb54-43629fa90165', '616d4e98-0b95-4786-9da7-ba6c4269bb80'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Delete snapshot completed successfully. Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ced119b1-b989-4440-8569-ed201eb550e0 tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-60e15f63-c86e-46b0-8028-12abfb6bb16c-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Creating offline snapshot ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d of volume f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[544d2e4c-befd-44ec-be96-9d25c8324242]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:38 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 Sep 25 12:53:38 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:39 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" returned: 0 in 0.697s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:39 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d 1G Sep 25 12:53:39 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-49f2247f-9459-43c5-a1b5-e6b53b56f472-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-49f2247f-9459-43c5-a1b5-e6b53b56f472-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95a30af-b35c-4cab-8ba1-4a0239d6a831]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:39 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:39 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:39 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d 1G" returned: 0 in 0.881s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:40 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d Sep 25 12:53:40 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:40 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.754s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:40 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472 Sep 25 12:53:40 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:40 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" returned: 0 in 0.628s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:40 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d is being set with open permissions: ugo+rw Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:40 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d Sep 25 12:53:40 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:40 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-49f2247f-9459-43c5-a1b5-e6b53b56f472" returned: 0 in 0.489s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-49f2247f-9459-43c5-a1b5-e6b53b56f472" released by "delete_volume" :: held 1.374s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:40 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['433661fc-3fce-4caf-8e28-fc65e92d2360', '78606180-162f-4829-a596-708be3f03643', '5e7571d7-f52a-4b74-88d7-89e0b7443388', '347f9b68-3316-4932-8cf1-1ed0a2ed8990'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:41 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:41 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:41 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" returned: 0 in 0.540s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:41 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info Sep 25 12:53:41 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:41 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.520s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:41 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Deleted volume successfully. Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-46495eea-3cc3-4dcb-82d0-d2ff48e9887b tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-49f2247f-9459-43c5-a1b5-e6b53b56f472-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:41 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-c23ad5eb-9a95-44fb-b221-0430bd3e9673-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info" returned: 0 in 0.666s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:41 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info is being set with open permissions: ugo+rw Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-c23ad5eb-9a95-44fb-b221-0430bd3e9673-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:41 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info Sep 25 12:53:41 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" acquired by "delete_volume" :: waited 0.051s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc576cc-264a-43cc-9575-d984a59970bb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:42 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 Sep 25 12:53:42 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:42 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.info" returned: 0 in 0.764s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a4f6b71f-803a-4926-b88f-0695bad1e64d tempest-CinderUnicodeTest-1822397577 None] Create snapshot completed successfully Sep 25 12:53:42 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673" returned: 0 in 0.736s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:42 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673 Sep 25 12:53:42 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:43 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c23ad5eb-9a95-44fb-b221-0430bd3e9673" returned: 0 in 0.631s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-quobyte-c23ad5eb-9a95-44fb-b221-0430bd3e9673" released by "delete_volume" :: held 1.529s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Created reservations ['5795ddc7-dc3d-488d-8175-00b857623aa1', 'd25e26e2-6fc8-4a7e-a3bb-931aeac209d5', 'ed0cb177-b15e-4b25-b4bd-a1dc62e365d0', '09269584-5104-481b-9fb3-c0e4628536cf'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-quobyte-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Deleting offline snapshot ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d of volume f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] snapshot_file for this snap is: volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c8f895-173a-4809-b2dc-d92f499c7b5a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:44 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:44 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:44 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d Sep 25 12:53:44 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:44 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.549s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Deleted volume successfully. Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8a2d8941-17b9-4d2b-b867-1c55b9e24a6c tempest-VolumesSnapshotTestJSON-1349096619 None] Lock "cinder-c23ad5eb-9a95-44fb-b221-0430bd3e9673-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:44 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" returned: 0 in 0.902s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a34a02-fd8b-4536-9718-c2f714a8ff81]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:45 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 Sep 25 12:53:45 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:45 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" returned: 0 in 0.732s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:45 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d Sep 25 12:53:45 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:46 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" returned: 0 in 0.443s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:46 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d Sep 25 12:53:46 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:46 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18.ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" returned: 0 in 0.312s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d" released by "_delete_snapshot" :: held 2.604s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" released by "delete_snapshot" :: held 2.658s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Created reservations ['bd6c9f5f-b615-4114-8924-da2b77f4c8ec', 'e5c5e369-4aa3-4b20-ae96-e5a9d3b68205', '8451aedd-00b9-4468-a8b0-7aa6acb2f6d9', '4454966b-00b3-4bb8-a090-862003ac7a2f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:46 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Delete snapshot completed successfully. Sep 25 12:53:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0d5183c4-99ec-4044-9a64-02d5731561d3 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-ecc9ff43-7bf8-4962-945a-d5d0cd2aa98d-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:47 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:47 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca53918-e729-48da-a3b2-1e4659bba875]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:47 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 Sep 25 12:53:47 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:47 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.489s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:53:47 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" returned: 0 in 0.573s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:48 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18 Sep 25 12:53:48 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:48 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18" released by "delete_volume" :: held 1.125s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Created reservations ['2da390e4-569b-45f2-9bbd-c59eafaa3994', '1a757ac0-f49d-4515-8cb2-66926fb09aa4', 'e2e361df-0e85-4751-9365-642293092353', '79bc533d-4bec-4345-b2cf-473e58321524'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:48 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:48 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:48 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.273s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Deleted volume successfully. Sep 25 12:53:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c4ae2e91-55e6-4bf7-aa97-b284ac40f474 tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-f57f8f93-cce1-48a8-bda5-1e4a8b45dc18-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-b1b7e5d1-6a25-4994-b023-42f4afc845f5-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-b1b7e5d1-6a25-4994-b023-42f4afc845f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "cinder-quobyte-b1b7e5d1-6a25-4994-b023-42f4afc845f5" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-b1b7e5d1-6a25-4994-b023-42f4afc845f5" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f24eef-6632-4e42-a7c7-a6678b73c23c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:49 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 Sep 25 12:53:49 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:50 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5" returned: 0 in 0.487s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:50 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5 Sep 25 12:53:50 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:50 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b1b7e5d1-6a25-4994-b023-42f4afc845f5" returned: 0 in 0.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-quobyte-b1b7e5d1-6a25-4994-b023-42f4afc845f5" released by "delete_volume" :: held 0.888s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Created reservations ['2f00de40-3229-453e-8d07-907b2b8e0cb0', 'ca64cfbd-f39a-43b5-8326-5d1cb21d1989', '9a8cac06-656b-49d0-9962-64cffbee065a', '4a8e5c1f-a726-4443-bbd4-2b3adac7095c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:50 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:53:50 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:51 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.442s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:51 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Deleted volume successfully. Sep 25 12:53:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-dfb77c66-79ae-459a-8bc6-5d98c0e3062c tempest-CinderUnicodeTest-1822397577 None] Lock "cinder-b1b7e5d1-6a25-4994-b023-42f4afc845f5-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Flow 'volume_create_manager' (7a35e0f3-7c4f-49b7-aa55-9f003f3e20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600541dd-6e40-435a-ac29-5734e7596c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600541dd-6e40-435a-ac29-5734e7596c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-170585404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6686a4-075b-4e79-b022-5f53234de770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b975cd534546eeae3396d51cb840c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:56Z,use_quota=True,user_id='48d22f41dfc04b8cac9efb047d3524de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e410dbc0-c7f9-4931-b484-1f91943095fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e410dbc0-c7f9-4931-b484-1f91943095fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9622665-12e1-4861-b93f-8cb15e337b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9622665-12e1-4861-b93f-8cb15e337b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6686a4-075b-4e79-b022-5f53234de770', 'volume_name': 'volume-2f6686a4-075b-4e79-b022-5f53234de770', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4451fa8-39d1-4a84-a764-dd6bf027ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4451fa8-39d1-4a84-a764-dd6bf027ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6402470-bb1c-40ac-874f-7e84fc1033c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Volume 2f6686a4-075b-4e79-b022-5f53234de770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6686a4-075b-4e79-b022-5f53234de770', 'volume_size': 1} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-170585404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6686a4-075b-4e79-b022-5f53234de770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b975cd534546eeae3396d51cb840c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:56Z,use_quota=True,user_id='48d22f41dfc04b8cac9efb047d3524de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Creating volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:56 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 1073741824 Sep 25 12:53:56 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:57 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 1073741824" returned: 0 in 0.759s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:57 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 Sep 25 12:53:57 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Flow 'volume_create_manager' (e8d06883-89af-4bc3-b45c-8999f041e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e49f2f1-2400-45c5-9b26-ac5d6d2a6581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e49f2f1-2400-45c5-9b26-ac5d6d2a6581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012279615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e2d08e-2697-47ae-a5c3-ad28abf262e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eb5b6abca4569a831af0b3e1d72d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:57Z,use_quota=True,user_id='fc36ddb53f6a4d9b9eb7ecf22cd8b32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff584bc-f7de-42d8-b6a7-0c277f51474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff584bc-f7de-42d8-b6a7-0c277f51474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3080382-db4c-46ed-b908-fc402b9fe6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3080382-db4c-46ed-b908-fc402b9fe6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e2d08e-2697-47ae-a5c3-ad28abf262e8', 'volume_name': 'volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4417b9da-b64b-4ce0-a8aa-adf165a1f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4417b9da-b64b-4ce0-a8aa-adf165a1f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199ebd36-7c2d-4125-ac5d-43925c21f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Volume 74e2d08e-2697-47ae-a5c3-ad28abf262e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8', 'volume_size': 1} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:57 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770" returned: 0 in 0.380s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012279615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e2d08e-2697-47ae-a5c3-ad28abf262e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eb5b6abca4569a831af0b3e1d72d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:57Z,use_quota=True,user_id='fc36ddb53f6a4d9b9eb7ecf22cd8b32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Creating volume 74e2d08e-2697-47ae-a5c3-ad28abf262e8 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:57 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:57 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 1073741824 Sep 25 12:53:57 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6402470-bb1c-40ac-874f-7e84fc1033c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6686a4-075b-4e79-b022-5f53234de770', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6518ce-6e45-4721-b61f-18e7258d9537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Volume volume-2f6686a4-075b-4e79-b022-5f53234de770 (2f6686a4-075b-4e79-b022-5f53234de770): created successfully Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6518ce-6e45-4721-b61f-18e7258d9537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Flow 'volume_create_manager' (7a35e0f3-7c4f-49b7-aa55-9f003f3e20f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4e19c4e1-0ada-492c-9cdc-38babbb4ad47 tempest-VolumesSnapshotListTestJSON-1998007130 None] Created volume successfully. Sep 25 12:53:58 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 1073741824" returned: 0 in 0.627s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:58 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 Sep 25 12:53:58 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:58 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8" returned: 0 in 0.360s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199ebd36-7c2d-4125-ac5d-43925c21f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95fc84d-e35f-46d2-9b1c-579faf01c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Volume volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 (74e2d08e-2697-47ae-a5c3-ad28abf262e8): created successfully Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95fc84d-e35f-46d2-9b1c-579faf01c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Flow 'volume_create_manager' (e8d06883-89af-4bc3-b45c-8999f041e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-14641eaa-c9a3-4e7c-9a05-d5bcaceb0521 tempest-ProjectReaderTests-918921368 None] Created volume successfully. Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Creating offline snapshot 4a2f85bd-0a20-4944-bb89-7a456bea9b72 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b784457f-7ade-4ee1-8337-5a501207f08b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:59 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 Sep 25 12:53:59 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:59 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:59 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 1G Sep 25 12:53:59 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Acquiring lock "cinder-74e2d08e-2697-47ae-a5c3-ad28abf262e8-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "cinder-74e2d08e-2697-47ae-a5c3-ad28abf262e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Acquiring lock "cinder-quobyte-74e2d08e-2697-47ae-a5c3-ad28abf262e8" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "cinder-quobyte-74e2d08e-2697-47ae-a5c3-ad28abf262e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[10300a07-6f0b-42a5-a8ed-b6548e5b3069]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 Sep 25 12:54:00 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 1G" returned: 0 in 0.640s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:00 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8" returned: 0 in 0.500s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8 Sep 25 12:54:00 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.405s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 is being set with open permissions: ugo+rw Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:00 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-74e2d08e-2697-47ae-a5c3-ad28abf262e8" returned: 0 in 0.351s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "cinder-quobyte-74e2d08e-2697-47ae-a5c3-ad28abf262e8" released by "delete_volume" :: held 0.917s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Created reservations ['412a6b4c-0f89-419b-8763-b942513cabb8', '1683e536-a49a-4b5b-8218-12623faf6321', 'd380e8ad-c55e-4278-9c85-5548b65914aa', 'c9c66a1b-821f-457f-b748-4361fca16d7e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:00 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:00 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info Sep 25 12:54:00 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:54:01 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:01 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info" returned: 0 in 0.401s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:01 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info is being set with open permissions: ugo+rw Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:01 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.375s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:54:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Deleted volume successfully. Sep 25 12:54:01 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info Sep 25 12:54:01 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7d94261f-8f87-4a68-9d29-927b6f170a23 tempest-ProjectReaderTests-918921368 None] Lock "cinder-74e2d08e-2697-47ae-a5c3-ad28abf262e8-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:01 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.info" returned: 0 in 0.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.827s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f4307d2f-5d48-40de-887d-e22a897a1410 tempest-VolumesSnapshotListTestJSON-1998007130 None] Create snapshot completed successfully Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Creating offline snapshot b067d820-5a32-454b-807e-2952498ae138 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c83a3-75ff-476c-afe1-4812082a38ab]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:02 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:02 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Flow 'volume_create_manager' (5bebf6e4-ffb4-4173-b22f-382875e4ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccde528-e2a6-42a5-a7eb-b25472fd87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccde528-e2a6-42a5-a7eb-b25472fd87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077232515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343f4036-5957-4d67-98bc-ba7b01bdbc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eb5b6abca4569a831af0b3e1d72d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:54:03Z,use_quota=True,user_id='fc36ddb53f6a4d9b9eb7ecf22cd8b32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80dfc8b-0184-47b8-9f32-dc01e0c651d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80dfc8b-0184-47b8-9f32-dc01e0c651d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8c43bf-6b47-4742-b92a-c5873aaf651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8c43bf-6b47-4742-b92a-c5873aaf651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343f4036-5957-4d67-98bc-ba7b01bdbc94', 'volume_name': 'volume-343f4036-5957-4d67-98bc-ba7b01bdbc94', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55c1204-6726-43ef-a1a1-7837724b42ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55c1204-6726-43ef-a1a1-7837724b42ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd44fb6-ee91-42b3-bae8-e4dcccb18df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:02 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Volume 343f4036-5957-4d67-98bc-ba7b01bdbc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343f4036-5957-4d67-98bc-ba7b01bdbc94', 'volume_size': 1} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:02 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.527s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:02 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 1G Sep 25 12:54:02 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:03 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 1G" returned: 0 in 0.539s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:03 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:03 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:03 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.382s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:03 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 is being set with open permissions: ugo+rw Sep 25 12:54:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:03 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:03 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:04 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077232515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343f4036-5957-4d67-98bc-ba7b01bdbc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8eb5b6abca4569a831af0b3e1d72d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:54:03Z,use_quota=True,user_id='fc36ddb53f6a4d9b9eb7ecf22cd8b32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Creating volume 343f4036-5957-4d67-98bc-ba7b01bdbc94 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:54:04 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:04 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 1073741824 Sep 25 12:54:04 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a6421b57-65bb-4a0c-9f4a-82fdc8c4f8da tempest-VolumesSnapshotListTestJSON-1998007130 None] Create snapshot completed successfully Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:04 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 1073741824" returned: 0 in 0.556s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:04 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 Sep 25 12:54:04 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:05 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94" returned: 0 in 0.306s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.441s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Creating offline snapshot d1e63119-0c26-47be-a41d-20cda22449c6 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd44fb6-ee91-42b3-bae8-e4dcccb18df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343f4036-5957-4d67-98bc-ba7b01bdbc94', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7cb805-c4c4-49e2-924a-644a5cb42c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a681584-5da5-4c17-b6fe-36e0f5219f7e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Volume volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 (343f4036-5957-4d67-98bc-ba7b01bdbc94): created successfully Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7cb805-c4c4-49e2-924a-644a5cb42c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Flow 'volume_create_manager' (5bebf6e4-ffb4-4173-b22f-382875e4ef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:54:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-533f9a39-ed54-4dcd-aa7d-6dfbc421603b tempest-ProjectReaderTests-918921368 None] Created volume successfully. Sep 25 12:54:05 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:05 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:05 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.488s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:05 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 1G Sep 25 12:54:05 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Acquiring lock "cinder-343f4036-5957-4d67-98bc-ba7b01bdbc94-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "cinder-343f4036-5957-4d67-98bc-ba7b01bdbc94-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Acquiring lock "cinder-quobyte-343f4036-5957-4d67-98bc-ba7b01bdbc94" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "cinder-quobyte-343f4036-5957-4d67-98bc-ba7b01bdbc94" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd51605-da48-44f1-86ac-bd01ef81985c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:06 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 Sep 25 12:54:06 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:06 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 1G" returned: 0 in 0.715s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:06 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 Sep 25 12:54:06 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:06 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94" returned: 0 in 0.574s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:06 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94 Sep 25 12:54:06 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:06 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6" returned: 0 in 0.386s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:06 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 is being set with open permissions: ugo+rw Sep 25 12:54:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:06 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 Sep 25 12:54:06 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:07 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-343f4036-5957-4d67-98bc-ba7b01bdbc94" returned: 0 in 0.325s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "cinder-quobyte-343f4036-5957-4d67-98bc-ba7b01bdbc94" released by "delete_volume" :: held 0.957s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=108,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=105,cinder:UPDATE=123,cinder:INSERT=42,cinder:DELETE=13 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:07 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Created reservations ['150be2da-a27d-477f-a8ad-0abe12797b4d', 'ab635603-5339-4e85-bf11-79f2cf628a06', '84b75cad-9bce-4a13-b015-7029b43a0850', 'cd974d61-aaa6-4a29-91cc-02303301b7cd'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6" returned: 0 in 0.395s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a2c45f05-1777-4e27-962e-cc325f95b242 tempest-VolumesSnapshotListTestJSON-1998007130 None] Create snapshot completed successfully Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:07 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:54:07 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:07 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.299s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:54:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Deleted volume successfully. Sep 25 12:54:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-83f788dc-cbab-48eb-b24f-6e3918bfe00c tempest-ProjectReaderTests-918921368 None] Lock "cinder-343f4036-5957-4d67-98bc-ba7b01bdbc94-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-d1e63119-0c26-47be-a41d-20cda22449c6-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-d1e63119-0c26-47be-a41d-20cda22449c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-d1e63119-0c26-47be-a41d-20cda22449c6" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-d1e63119-0c26-47be-a41d-20cda22449c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Deleting offline snapshot d1e63119-0c26-47be-a41d-20cda22449c6 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] snapshot_file for this snap is: volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8544a53a-765d-4b05-a8aa-b74a5e18fab0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:09 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 Sep 25 12:54:09 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:09 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6" returned: 0 in 0.440s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5351afa-0a0e-4058-9b58-e59ebdf5c227]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:09 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:09 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:10 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.500s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:10 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 Sep 25 12:54:10 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:10 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6" returned: 0 in 0.485s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:10 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6 Sep 25 12:54:10 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:11 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.d1e63119-0c26-47be-a41d-20cda22449c6" returned: 0 in 0.324s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-d1e63119-0c26-47be-a41d-20cda22449c6" released by "_delete_snapshot" :: held 1.879s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" released by "delete_snapshot" :: held 1.907s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Created reservations ['e28529af-8da1-44ba-9dff-e5bd24d138d3', 'a6613e91-9172-47eb-8af9-8caf2812b2be', '7e72107f-eaa9-4283-845a-02378f432e19', '5e27ed20-5aae-4171-b7c2-f14c97f39624'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Delete snapshot completed successfully. Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a4b4bd02-31a0-4ee8-9500-e705ec21e943 tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-d1e63119-0c26-47be-a41d-20cda22449c6-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-b067d820-5a32-454b-807e-2952498ae138-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-b067d820-5a32-454b-807e-2952498ae138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-b067d820-5a32-454b-807e-2952498ae138" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-b067d820-5a32-454b-807e-2952498ae138" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Deleting offline snapshot b067d820-5a32-454b-807e-2952498ae138 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] snapshot_file for this snap is: volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e2223-b881-466b-af39-7d3698d7f002]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:11 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:11 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:12 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca63043-92f8-4ff6-bbad-2c77656f5b63]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:12 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:12 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:12 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.584s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:12 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:12 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:13 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.592s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:13 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138 Sep 25 12:54:13 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:13 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.b067d820-5a32-454b-807e-2952498ae138" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-b067d820-5a32-454b-807e-2952498ae138" released by "_delete_snapshot" :: held 2.167s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" released by "delete_snapshot" :: held 2.194s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Created reservations ['14b9ef7a-1d90-49b9-96a4-e6c9ef6d822d', 'f8503666-27ee-4be3-b915-428c869a07e0', 'de60b5a7-53a6-4eee-8c7e-25a3ea981ed0', 'a1e7357a-cca0-455d-95ad-29d9c30864bc'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Delete snapshot completed successfully. Sep 25 12:54:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-19a1c5f1-80a2-44bb-b803-dded2f57724a tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-b067d820-5a32-454b-807e-2952498ae138-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-4a2f85bd-0a20-4944-bb89-7a456bea9b72-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-4a2f85bd-0a20-4944-bb89-7a456bea9b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-4a2f85bd-0a20-4944-bb89-7a456bea9b72" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-4a2f85bd-0a20-4944-bb89-7a456bea9b72" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Deleting offline snapshot 4a2f85bd-0a20-4944-bb89-7a456bea9b72 of volume 2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] snapshot_file for this snap is: volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9568676-14cc-45ed-8f9f-73bf78c3de43]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:14 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:14 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:15 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.438s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6686a4-075b-4e79-b022-5f53234de770(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace0c89a-0c50-4616-8ea9-e10311609a6b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:15 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 Sep 25 12:54:15 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:15 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:15 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:15 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:16 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:16 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72 Sep 25 12:54:16 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:16 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770.4a2f85bd-0a20-4944-bb89-7a456bea9b72" returned: 0 in 0.304s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-4a2f85bd-0a20-4944-bb89-7a456bea9b72" released by "_delete_snapshot" :: held 1.788s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" released by "delete_snapshot" :: held 1.818s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Created reservations ['51457157-9664-43e1-939d-7098d871b13d', '73ba97bc-fbc5-480b-b91d-bd0212e90c04', '075036ba-2d5a-4074-88ee-073d1a801d42', 'c9215197-79c2-40a6-b088-0b25fa328a6f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Delete snapshot completed successfully. Sep 25 12:54:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8ade92a3-c724-4e52-880f-bbff47537a1d tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-4a2f85bd-0a20-4944-bb89-7a456bea9b72-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-2f6686a4-075b-4e79-b022-5f53234de770-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-2f6686a4-075b-4e79-b022-5f53234de770-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf267565-49da-47eb-9831-9e280e5b9aca]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:17 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 Sep 25 12:54:17 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:17 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770" returned: 0 in 0.481s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:17 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770 Sep 25 12:54:17 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:18 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2f6686a4-075b-4e79-b022-5f53234de770" returned: 0 in 0.289s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-quobyte-2f6686a4-075b-4e79-b022-5f53234de770" released by "delete_volume" :: held 0.854s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Created reservations ['615fe403-de0c-4db7-a2d5-c7a5334c0b52', '5f67e08a-600a-4fb6-99d2-29395f41b72c', '2fdc9ebe-882d-4f14-8cc9-d25d0372ecd2', '535898bf-7db8-485f-9f3a-6ca461d416de'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:18 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:54:18 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:18 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.320s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:54:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Deleted volume successfully. Sep 25 12:54:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07e6f737-f88b-4e5b-bba3-44d5d767c94c tempest-VolumesSnapshotListTestJSON-1998007130 None] Lock "cinder-2f6686a4-075b-4e79-b022-5f53234de770-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-9ee55770-b84e-4a43-9524-8102689182dc req-0f0794c6-df54-4a9f-9aaa-ca933de61e8e tempest-TestShelveInstance-87718229 None] Terminate volume connection completed successfully. Sep 25 12:54:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-9ee55770-b84e-4a43-9524-8102689182dc req-0f0794c6-df54-4a9f-9aaa-ca933de61e8e tempest-TestShelveInstance-87718229 None] Deleting attachment 43e67c7d-12be-400d-893d-a12c1424f970. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:54:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5b131d75-0de0-437e-88e2-5b875700f757 req-849f61a4-564e-4fca-b79d-5885f9189139 tempest-TestShelveInstance-87718229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5b131d75-0de0-437e-88e2-5b875700f757 req-849f61a4-564e-4fca-b79d-5885f9189139 tempest-TestShelveInstance-87718229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5b131d75-0de0-437e-88e2-5b875700f757 req-849f61a4-564e-4fca-b79d-5885f9189139 tempest-TestShelveInstance-87718229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-5b131d75-0de0-437e-88e2-5b875700f757 req-849f61a4-564e-4fca-b79d-5885f9189139 tempest-TestShelveInstance-87718229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-f54e5343-c722-4e89-9224-235586c9a468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2623d56a-27bd-4409-9e0b-c906671a771d', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:54:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-5b131d75-0de0-437e-88e2-5b875700f757 req-849f61a4-564e-4fca-b79d-5885f9189139 tempest-TestShelveInstance-87718229 None] attachment_update completed successfully. Sep 25 12:54:38 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:38 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=41,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:54:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:54:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Flow 'volume_create_manager' (97f848a3-907e-4173-a4f3-c47598fa6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839fb2b9-8c43-40b2-952c-92b96ed96410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839fb2b9-8c43-40b2-952c-92b96ed96410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-925797566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a0b246-ea76-4e68-8cf1-f293b8841fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00853c37a5744fda88050323deb23c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:08Z,use_quota=True,user_id='0c974a2f2870406aab5f09a038d97178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe79f54-8cdb-4ad4-a033-652f47cc3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe79f54-8cdb-4ad4-a033-652f47cc3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb0ced-266f-49fd-9e3d-903e70398c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb0ced-266f-49fd-9e3d-903e70398c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a0b246-ea76-4e68-8cf1-f293b8841fc4', 'volume_name': 'volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a580d32d-e582-491c-a936-2c058aec7979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a580d32d-e582-491c-a936-2c058aec7979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77a4cc1-0388-451a-ac8d-b20e137b1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:08 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Volume d8a0b246-ea76-4e68-8cf1-f293b8841fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4', 'volume_size': 1} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-925797566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a0b246-ea76-4e68-8cf1-f293b8841fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00853c37a5744fda88050323deb23c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:08Z,use_quota=True,user_id='0c974a2f2870406aab5f09a038d97178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Creating volume d8a0b246-ea76-4e68-8cf1-f293b8841fc4 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:08 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:55:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:08 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 1073741824 Sep 25 12:55:08 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:09 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 1073741824" returned: 0 in 0.710s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:09 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 Sep 25 12:55:09 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:09 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" returned: 0 in 0.317s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77a4cc1-0388-451a-ac8d-b20e137b1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f181f92-370c-4fe4-a6db-dd821b8ef03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:09 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Volume volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 (d8a0b246-ea76-4e68-8cf1-f293b8841fc4): created successfully Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f181f92-370c-4fe4-a6db-dd821b8ef03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:09 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Flow 'volume_create_manager' (97f848a3-907e-4173-a4f3-c47598fa6637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:09 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d6ca5e9f-5630-4f7c-a19c-5d1c0de0257c tempest-TestMinimumBasicScenario-714281411 None] Created volume successfully. Sep 25 12:55:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5fe8c293-ba5b-46ee-a8cb-783080a6badf req-66b0105c-7765-43f9-89c2-8d8a6ff06b3d tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5fe8c293-ba5b-46ee-a8cb-783080a6badf req-66b0105c-7765-43f9-89c2-8d8a6ff06b3d tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-5fe8c293-ba5b-46ee-a8cb-783080a6badf req-66b0105c-7765-43f9-89c2-8d8a6ff06b3d tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:11 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-5fe8c293-ba5b-46ee-a8cb-783080a6badf req-66b0105c-7765-43f9-89c2-8d8a6ff06b3d tempest-TestMinimumBasicScenario-714281411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '279f2b0e-5aab-4203-85dc-2246f38fb4a6', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:55:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-5fe8c293-ba5b-46ee-a8cb-783080a6badf req-66b0105c-7765-43f9-89c2-8d8a6ff06b3d tempest-TestMinimumBasicScenario-714281411 None] attachment_update completed successfully. Sep 25 12:55:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-817962c1-150c-481a-8915-fcc9f7d4e898 tempest-TestShelveInstance-87718229 None] Terminate volume connection completed successfully. Sep 25 12:55:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-817962c1-150c-481a-8915-fcc9f7d4e898 tempest-TestShelveInstance-87718229 None] Deleting attachment 2623d56a-27bd-4409-9e0b-c906671a771d. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:55:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Acquiring lock "cinder-f54e5343-c722-4e89-9224-235586c9a468-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "cinder-f54e5343-c722-4e89-9224-235586c9a468-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Acquiring lock "cinder-quobyte-f54e5343-c722-4e89-9224-235586c9a468" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "cinder-quobyte-f54e5343-c722-4e89-9224-235586c9a468" acquired by "delete_volume" :: waited 0.066s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[20915e0e-cd4e-46c4-baa2-143c81a99cda]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:19 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 Sep 25 12:55:19 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:20 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468" returned: 0 in 0.811s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:20 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468 Sep 25 12:55:20 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:20 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f54e5343-c722-4e89-9224-235586c9a468" returned: 0 in 0.424s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "cinder-quobyte-f54e5343-c722-4e89-9224-235586c9a468" released by "delete_volume" :: held 1.343s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG cinder.quota [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Created reservations ['02cee08e-e201-4716-8749-602a3c5c6ef2', '1a9bdc65-b49b-43c9-8dd8-79ff0f306ded', 'efcac6b3-708b-4499-ac9b-4769e3026811', '467c572e-ee6f-4cdf-9802-7aed978a1827'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:20 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:55:20 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:20 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.279s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:21 devstack cinder-volume[87094]: DEBUG cinder.manager [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Deleted volume successfully. Sep 25 12:55:21 devstack cinder-volume[87094]: DEBUG cinder.coordination [req-2731ee3e-d91c-40de-9c93-ae2fcad4712d req-592405ee-4403-4579-9c34-b8d4caeb98c6 tempest-TestShelveInstance-87718229 None] Lock "cinder-f54e5343-c722-4e89-9224-235586c9a468-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:30 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:31 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:47 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:55:47 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:47 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:55:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:56:11 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Flow 'volume_create_manager' (fe64a28f-dd58-44dc-a903-c59d7fd4d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65949627-d958-43a5-bfe8-fd0c46385ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65949627-d958-43a5-bfe8-fd0c46385ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1489065081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9d0110-f24a-47a9-af8d-08a5b7877de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29d8d17fa14524bad67d00acb9e398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:12Z,use_quota=True,user_id='450289066fcb4ac586e0b56a032b97de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112986d3-81ca-46e9-a08b-3a184c7b6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112986d3-81ca-46e9-a08b-3a184c7b6a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba78c82-5008-42fc-b538-2d9f24c7365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba78c82-5008-42fc-b538-2d9f24c7365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9d0110-f24a-47a9-af8d-08a5b7877de0', 'volume_name': 'volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992745bc-e231-4f0b-9a8f-f9be0d15f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992745bc-e231-4f0b-9a8f-f9be0d15f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defbe547-be8e-467a-a3bc-7abcee7f61d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Volume 1a9d0110-f24a-47a9-af8d-08a5b7877de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0', 'volume_size': 1} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1489065081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9d0110-f24a-47a9-af8d-08a5b7877de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29d8d17fa14524bad67d00acb9e398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:12Z,use_quota=True,user_id='450289066fcb4ac586e0b56a032b97de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Creating volume 1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:12 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:12 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 1073741824 Sep 25 12:56:12 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:12 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 1073741824" returned: 0 in 0.570s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:12 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:12 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:13 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.299s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defbe547-be8e-467a-a3bc-7abcee7f61d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6592ae-778d-4765-a546-e5c7b408f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Volume volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 (1a9d0110-f24a-47a9-af8d-08a5b7877de0): created successfully Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6592ae-778d-4765-a546-e5c7b408f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Flow 'volume_create_manager' (fe64a28f-dd58-44dc-a903-c59d7fd4d159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5ff5694a-6252-46f9-87f5-07bd5fe99a4c tempest-SnapshotDependencyTests-208009852 None] Created volume successfully. Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Creating offline snapshot b6db1641-2bc6-4329-a905-4a377135322d of volume 1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de17cf2-e2cd-4d3e-9bdf-a0b17aaa49a7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:14 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:14 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:14 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.502s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:15 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d 1G Sep 25 12:56:15 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:15 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d 1G" returned: 0 in 0.566s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:15 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:15 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.459s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:16 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d is being set with open permissions: ugo+rw Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:16 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:16 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.361s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:16 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info Sep 25 12:56:16 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info" returned: 0 in 0.363s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:16 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info is being set with open permissions: ugo+rw Sep 25 12:56:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:16 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info Sep 25 12:56:16 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:17 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.info" returned: 0 in 0.336s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7aa1f309-a04a-4c3e-b87f-76222b18facc tempest-SnapshotDependencyTests-208009852 None] Create snapshot completed successfully Sep 25 12:56:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-644fa0ab-23ad-4637-97aa-01b8d9c5b7fd req-f80fec61-9cc3-4433-945c-325ec9202eb8 tempest-TestMinimumBasicScenario-714281411 None] Terminate volume connection completed successfully. Sep 25 12:56:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-644fa0ab-23ad-4637-97aa-01b8d9c5b7fd req-f80fec61-9cc3-4433-945c-325ec9202eb8 tempest-TestMinimumBasicScenario-714281411 None] Deleting attachment 279f2b0e-5aab-4203-85dc-2246f38fb4a6. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "cinder-d8a0b246-ea76-4e68-8cf1-f293b8841fc4-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "cinder-d8a0b246-ea76-4e68-8cf1-f293b8841fc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "cinder-quobyte-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "cinder-quobyte-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Flow 'volume_create_manager' (2f01beec-4c43-4cd2-b16b-f61940aeb539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d86b05-c0d0-4dd9-9add-d98a996548f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ce572a-c143-4f97-827e-a86e0878ec01]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d86b05-c0d0-4dd9-9add-d98a996548f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e090c7b4-343f-4650-9235-7cb44fb16721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc29d8d17fa14524bad67d00acb9e398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6db1641-2bc6-4329-a905-4a377135322d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:18Z,use_quota=True,user_id='450289066fcb4ac586e0b56a032b97de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ddf4cb-9004-40a1-835a-88c60c36b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ddf4cb-9004-40a1-835a-88c60c36b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45971f9-53aa-4fbb-8f68-f2062db44291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45971f9-53aa-4fbb-8f68-f2062db44291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e090c7b4-343f-4650-9235-7cb44fb16721', 'volume_name': 'volume-e090c7b4-343f-4650-9235-7cb44fb16721', 'volume_size': 1, 'snapshot_id': 'b6db1641-2bc6-4329-a905-4a377135322d'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce2bca6-dbb2-4950-8059-fe1a1593ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce2bca6-dbb2-4950-8059-fe1a1593ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c75727-83cf-47d6-ac34-ee2e0dd5599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Volume e090c7b4-343f-4650-9235-7cb44fb16721: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e090c7b4-343f-4650-9235-7cb44fb16721', 'volume_size': 1, 'snapshot_id': 'b6db1641-2bc6-4329-a905-4a377135322d'} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d-e090c7b4-343f-4650-9235-7cb44fb16721" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d-e090c7b4-343f-4650-9235-7cb44fb16721" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Creating volume e090c7b4-343f-4650-9235-7cb44fb16721 from snapshot b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:18 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 Sep 25 12:56:18 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] snapshot: b6db1641-2bc6-4329-a905-4a377135322d, volume: e090c7b4-343f-4650-9235-7cb44fb16721, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e199b2-b399-4d72-84b1-ec0c8f411ebd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:18 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:18 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" returned: 0 in 0.489s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4 Sep 25 12:56:19 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.460s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a6b421-7160-438a-b1e3-91ad5f0744eb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" returned: 0 in 0.304s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "cinder-quobyte-d8a0b246-ea76-4e68-8cf1-f293b8841fc4" released by "delete_volume" :: held 0.882s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:19 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:19 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Created reservations ['e0c8ab97-e498-4c78-954d-10ec17d05134', 'aa4e1aab-40df-40e4-b466-b03e6d0c8f38', '2d006f24-34cd-4c40-bac8-b873bd26f254', '1b75d5bc-f182-4899-90a3-8143f4c4846a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:56:19 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.479s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 Sep 25 12:56:19 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Deleted volume successfully. Sep 25 12:56:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1681991c-90b9-4de8-a22e-e5918c7fa5b9 tempest-TestMinimumBasicScenario-714281411 None] Lock "cinder-d8a0b246-ea76-4e68-8cf1-f293b8841fc4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:28 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721" returned: 0 in 8.589s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:56:28 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Converted 1024.00 MB image at 119.21 MB/s Sep 25 12:56:28 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 is being set with open permissions: ugo+rw Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:28 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 Sep 25 12:56:28 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:28 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721" returned: 0 in 0.324s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" released by "_copy_volume_from_snapshot" :: held 9.966s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d-e090c7b4-343f-4650-9235-7cb44fb16721" released by "_create_volume_from_snapshot" :: held 10.055s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.078s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c75727-83cf-47d6-ac34-ee2e0dd5599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e090c7b4-343f-4650-9235-7cb44fb16721', 'volume_size': 1, 'snapshot_id': 'b6db1641-2bc6-4329-a905-4a377135322d'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd879c03-4984-42b7-a60a-759d4494fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Volume volume-e090c7b4-343f-4650-9235-7cb44fb16721 (e090c7b4-343f-4650-9235-7cb44fb16721): created successfully Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd879c03-4984-42b7-a60a-759d4494fb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Flow 'volume_create_manager' (2f01beec-4c43-4cd2-b16b-f61940aeb539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e74206f4-bf12-4601-a790-10e6ddacca61 tempest-SnapshotDependencyTests-208009852 None] Created volume successfully. Sep 25 12:56:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-b6db1641-2bc6-4329-a905-4a377135322d-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-b6db1641-2bc6-4329-a905-4a377135322d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Deleting offline snapshot b6db1641-2bc6-4329-a905-4a377135322d of volume 1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] snapshot_file for this snap is: volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ca223-ab62-4e10-8ff1-0d3dab212ac8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:30 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:30 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:30 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.535s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d30228-7ad8-47ca-be1b-f74c8ccafa44]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:30 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:30 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:31 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.661s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:31 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:31 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:31 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:31 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d Sep 25 12:56:31 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:32 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0.b6db1641-2bc6-4329-a905-4a377135322d" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-b6db1641-2bc6-4329-a905-4a377135322d" released by "_delete_snapshot" :: held 2.229s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" released by "delete_snapshot" :: held 2.262s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:32 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Created reservations ['f0191705-c01e-4766-8485-7f5aeb284d64', '214b57bb-f7ce-4ddc-a58e-420d6a4e087e', 'd69d6439-909b-44c5-97e0-08096b144a2a', '90f7d07f-945b-4946-bdf2-65d9b9c71d84'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Delete snapshot completed successfully. Sep 25 12:56:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-49214da3-c994-494e-9277-871170fdac70 tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-b6db1641-2bc6-4329-a905-4a377135322d-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-1a9d0110-f24a-47a9-af8d-08a5b7877de0-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-1a9d0110-f24a-47a9-af8d-08a5b7877de0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8d5c7-48a3-4839-bb14-659b23cf34e7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:33 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:33 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:33 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.483s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:33 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0 Sep 25 12:56:33 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:34 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1a9d0110-f24a-47a9-af8d-08a5b7877de0" returned: 0 in 0.328s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-1a9d0110-f24a-47a9-af8d-08a5b7877de0" released by "delete_volume" :: held 0.895s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Created reservations ['7ff97630-da34-4820-aaa1-c18a7119e832', '54eef436-e4ba-4bf4-ae3c-f951c78c2b59', 'b47baa54-6d43-4c8b-8a51-16d7543b0fe4', '8eed4a0b-354f-4fe7-98dd-cece2547eab4'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:34 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:56:34 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-e090c7b4-343f-4650-9235-7cb44fb16721-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-e090c7b4-343f-4650-9235-7cb44fb16721-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" acquired by "delete_volume" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d9a7d-bd3b-425a-9bb9-6973075c47e3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:34 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.328s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:34 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 Sep 25 12:56:34 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Deleted volume successfully. Sep 25 12:56:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-321e3713-487a-48d3-a838-ee86ed37237c tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-1a9d0110-f24a-47a9-af8d-08a5b7877de0-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:35 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721" returned: 0 in 0.468s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:35 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721 Sep 25 12:56:35 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:35 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e090c7b4-343f-4650-9235-7cb44fb16721" returned: 0 in 0.303s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-quobyte-e090c7b4-343f-4650-9235-7cb44fb16721" released by "delete_volume" :: held 0.828s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Created reservations ['a6f61a07-2be0-4a54-83d5-76ba5090ac2a', '3ee44e0a-1e27-4290-90aa-f32fb635d38f', '2bc37b78-7acc-4625-aabf-848553975cab', '0eed6cf5-a22b-4fbd-8493-28e828361d46'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:35 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:56:35 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:35 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.375s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:35 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:35 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Deleted volume successfully. Sep 25 12:56:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a3bb351e-336c-4749-9439-573d7baa4f7b tempest-SnapshotDependencyTests-208009852 None] Lock "cinder-e090c7b4-343f-4650-9235-7cb44fb16721-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:45 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=32,cinder:SELECT=33,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:46 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=28,cinder:UPDATE=42,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:47 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:56:47 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:47 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.341s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:56:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Flow 'volume_create_manager' (cc0f10d5-1314-4677-b0ef-a8844e0b409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a734a35f-9576-4648-85b8-f4e1d66db85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a734a35f-9576-4648-85b8-f4e1d66db85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-573510270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277d7d19b23448e194ac3bfec1ada1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:06Z,use_quota=True,user_id='8f215d4add4d4e138c11bd9f4649bde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3657ccb-ac87-4c8c-adec-7d48a178adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3657ccb-ac87-4c8c-adec-7d48a178adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d1a960-7a4b-47c9-9bb5-88fb25ea5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d1a960-7a4b-47c9-9bb5-88fb25ea5879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c', 'volume_name': 'volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3db709-52d9-4267-bc18-27e3c2726ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3db709-52d9-4267-bc18-27e3c2726ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b648c19-d165-457a-bf89-8ce7edd049c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Volume a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c', 'volume_size': 1} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-573510270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277d7d19b23448e194ac3bfec1ada1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:06Z,use_quota=True,user_id='8f215d4add4d4e138c11bd9f4649bde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Creating volume a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:57:06 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:06 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c 1073741824 Sep 25 12:57:06 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:06 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c 1073741824" returned: 0 in 0.548s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:06 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:06 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:07 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.299s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b648c19-d165-457a-bf89-8ce7edd049c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd94f4f-9758-4289-9d9b-97ab8c040596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Volume volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c (a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c): created successfully Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd94f4f-9758-4289-9d9b-97ab8c040596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Flow 'volume_create_manager' (cc0f10d5-1314-4677-b0ef-a8844e0b409a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d63f6489-dd37-40ce-8349-dd852328b224 tempest-TestImageHashVerification-1969912111 None] Created volume successfully. Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d823b-e3ad-47a6-875c-496da05d8266]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:09 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:09 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:09 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.487s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc19f4e-eacc-455c-8eca-9982d5ce98b7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:10 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:10 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:10 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.417s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c /opt/stack/data/cinder/conversion/a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c.temp_image.9e62f492-c8bd-4e83-88ff-43289b1a778a5l9dy0qc.img {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:10 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c /opt/stack/data/cinder/conversion/a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c.temp_image.9e62f492-c8bd-4e83-88ff-43289b1a778a5l9dy0qc.img Sep 25 12:57:10 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:16 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c /opt/stack/data/cinder/conversion/a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c.temp_image.9e62f492-c8bd-4e83-88ff-43289b1a778a5l9dy0qc.img" returned: 0 in 6.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5129cab4-c53d-4e7f-9b72-65452bf3f6ee]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:16 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:16 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:17 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:17 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.596s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:17 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/conversion/a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c.temp_image.9e62f492-c8bd-4e83-88ff-43289b1a778a5l9dy0qc.img {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:57:17 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Converted 1024.00 MB image at 160.52 MB/s Sep 25 12:57:17 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] 9e62f492-c8bd-4e83-88ff-43289b1a778a was raw, no need to convert to raw {{(pid=87094) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 12:57:27 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:27 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.687s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Uploaded volume to glance image-id: 9e62f492-c8bd-4e83-88ff-43289b1a778a. {{(pid=87094) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 12:57:37 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4c164d84-87b9-4269-b35d-6fe42fcdf207 tempest-TestImageHashVerification-1969912111 None] Copy volume to image completed successfully. Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "cinder-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "cinder-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "cinder-quobyte-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "cinder-quobyte-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" acquired by "delete_volume" :: waited 0.014s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a31dec6-f559-42bf-9380-c14788aa9b1c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:38 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:38 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:38 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:38 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c Sep 25 12:57:38 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:39 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" returned: 0 in 0.276s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "cinder-quobyte-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c" released by "delete_volume" :: held 0.720s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Created reservations ['a1d985d3-7a37-4510-9705-c42b17af1342', 'fc4aff0a-835a-41b5-9604-5598fce6898c', '91c4af3a-3b7f-4c56-8c4a-da8ac2cc11ec', '4ae579e9-1a15-4700-8229-40b9f81cbba5'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:39 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:57:39 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:39 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Deleted volume successfully. Sep 25 12:57:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-423d5d82-d596-46ff-92e2-e61eeeac4652 tempest-TestImageHashVerification-1969912111 None] Lock "cinder-a62ae5bb-3b6a-43cc-b5c5-d9eded4eab3c-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:47 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:57:47 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:47 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.263s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:57:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:57:49 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:49 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Flow 'volume_create_manager' (1fc815b0-246c-4dfe-825a-3de758aa5c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ed3a6f-2de1-479a-9826-94a57e0b87b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ed3a6f-2de1-479a-9826-94a57e0b87b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-382512985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637526f4-40af-4544-b5f9-57c70c1ebb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e1816ed2804c3cbe92855258ae614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:16Z,use_quota=True,user_id='a16be7d8234c4db59881df9fcfa7d10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71839501-5f34-4b77-a1c8-7dcf817f3674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71839501-5f34-4b77-a1c8-7dcf817f3674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7389b058-8058-4109-8d79-0bac5a75b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7389b058-8058-4109-8d79-0bac5a75b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637526f4-40af-4544-b5f9-57c70c1ebb6f', 'volume_name': 'volume-637526f4-40af-4544-b5f9-57c70c1ebb6f', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f8944-a47b-455b-88be-52ed04601bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f8944-a47b-455b-88be-52ed04601bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2310c70c-a44e-4cac-ae5b-59826b2970cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:15 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Volume 637526f4-40af-4544-b5f9-57c70c1ebb6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637526f4-40af-4544-b5f9-57c70c1ebb6f', 'volume_size': 1} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-382512985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637526f4-40af-4544-b5f9-57c70c1ebb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e1816ed2804c3cbe92855258ae614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:16Z,use_quota=True,user_id='a16be7d8234c4db59881df9fcfa7d10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Creating volume 637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:58:15 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 12:58:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:15 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f 1073741824 Sep 25 12:58:15 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:16 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f 1073741824" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:16 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 12:58:16 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:16 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2310c70c-a44e-4cac-ae5b-59826b2970cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637526f4-40af-4544-b5f9-57c70c1ebb6f', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a69dc5-b7cf-4a74-ac22-04534ca1886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:16 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Volume volume-637526f4-40af-4544-b5f9-57c70c1ebb6f (637526f4-40af-4544-b5f9-57c70c1ebb6f): created successfully Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a69dc5-b7cf-4a74-ac22-04534ca1886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:16 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Flow 'volume_create_manager' (1fc815b0-246c-4dfe-825a-3de758aa5c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d9ba2b8d-deaf-43df-8965-e1a114db3d46 tempest-TestStampPattern-622553893 None] Created volume successfully. Sep 25 12:58:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:26 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:47 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:58:47 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:47 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.347s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:58:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:58:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-71be7e31-4b93-4541-bf8f-508597abc5d4 req-c0577dd0-10af-411a-97e4-e13c1e2c0bff tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-71be7e31-4b93-4541-bf8f-508597abc5d4 req-c0577dd0-10af-411a-97e4-e13c1e2c0bff tempest-TestStampPattern-622553893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-71be7e31-4b93-4541-bf8f-508597abc5d4 req-c0577dd0-10af-411a-97e4-e13c1e2c0bff tempest-TestStampPattern-622553893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-71be7e31-4b93-4541-bf8f-508597abc5d4 req-c0577dd0-10af-411a-97e4-e13c1e2c0bff tempest-TestStampPattern-622553893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-637526f4-40af-4544-b5f9-57c70c1ebb6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33c5e4de-478c-4285-a096-859ae5ece929', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:58:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-71be7e31-4b93-4541-bf8f-508597abc5d4 req-c0577dd0-10af-411a-97e4-e13c1e2c0bff tempest-TestStampPattern-622553893 None] attachment_update completed successfully. Sep 25 12:58:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-821f65e5-162f-403a-a0e4-db1096c210dd req-5a3f8846-84c5-4636-ab38-aed3bfa9385a tempest-TestStampPattern-622553893 None] Terminate volume connection completed successfully. Sep 25 12:58:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-821f65e5-162f-403a-a0e4-db1096c210dd req-5a3f8846-84c5-4636-ab38-aed3bfa9385a tempest-TestStampPattern-622553893 None] Deleting attachment 33c5e4de-478c-4285-a096-859ae5ece929. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:58:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Creating offline snapshot e9795704-ed91-46cf-995c-674b76287721 of volume 637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:58:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a380e1a-5a8e-411f-89a5-a0812117b249]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:58:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:54 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 12:58:54 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:55 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:55 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 1G Sep 25 12:58:55 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:55 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 1G" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637526f4-40af-4544-b5f9-57c70c1ebb6f -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:55 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637526f4-40af-4544-b5f9-57c70c1ebb6f -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 12:58:55 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:56 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637526f4-40af-4544-b5f9-57c70c1ebb6f -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.331s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:56 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 is being set with open permissions: ugo+rw Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:56 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 12:58:56 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:56 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.279s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:56 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info Sep 25 12:58:56 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:56 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info" returned: 0 in 0.286s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:56 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info is being set with open permissions: ugo+rw Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:56 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info Sep 25 12:58:56 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:56 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.info" returned: 0 in 0.331s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-46736e89-6538-4014-96ef-39ffbfd51720 tempest-TestStampPattern-622553893 None] Create snapshot completed successfully Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Flow 'volume_create_manager' (cec8214b-e508-43c5-8e81-7533fb415528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0911e7d3-1c49-4af9-8167-e1e89919ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0911e7d3-1c49-4af9-8167-e1e89919ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1618967295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc82d6b-114c-43cf-aa8a-2de788ba61ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e1816ed2804c3cbe92855258ae614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9795704-ed91-46cf-995c-674b76287721,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:06Z,use_quota=True,user_id='a16be7d8234c4db59881df9fcfa7d10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffefa0-8bb1-416b-9e21-b27dcb5c4f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffefa0-8bb1-416b-9e21-b27dcb5c4f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57543eaa-0327-4b56-b439-217294d677e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57543eaa-0327-4b56-b439-217294d677e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6dc82d6b-114c-43cf-aa8a-2de788ba61ce', 'volume_name': 'volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce', 'volume_size': 1, 'snapshot_id': 'e9795704-ed91-46cf-995c-674b76287721'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad7063c-3038-4e50-9289-2066cb5dc066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad7063c-3038-4e50-9289-2066cb5dc066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273ba51f-d4a9-4c3a-84b3-d3e5cc23d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Volume 6dc82d6b-114c-43cf-aa8a-2de788ba61ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce', 'volume_size': 1, 'snapshot_id': 'e9795704-ed91-46cf-995c-674b76287721'} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Creating volume 6dc82d6b-114c-43cf-aa8a-2de788ba61ce from snapshot e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] snapshot: e9795704-ed91-46cf-995c-674b76287721, volume: 6dc82d6b-114c-43cf-aa8a-2de788ba61ce, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[61069908-f71f-42ee-8c33-e5655003a071]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:06 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 12:59:06 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:07 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.455s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637526f4-40af-4544-b5f9-57c70c1ebb6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cd3c6-8995-4825-b463-83588142982d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:07 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 12:59:07 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:07 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.416s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 12:59:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:07 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce Sep 25 12:59:07 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:16 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:16 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:17 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" returned: 0 in 9.619s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f, size 1024.00 MB, duration 9.62 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:59:17 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Converted 1024.00 MB image at 106.44 MB/s Sep 25 12:59:17 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce is being set with open permissions: ugo+rw Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:17 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce Sep 25 12:59:17 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:17 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" returned: 0 in 0.495s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" released by "_copy_volume_from_snapshot" :: held 11.110s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" released by "_create_volume_from_snapshot" :: held 11.205s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.228s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273ba51f-d4a9-4c3a-84b3-d3e5cc23d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce', 'volume_size': 1, 'snapshot_id': 'e9795704-ed91-46cf-995c-674b76287721'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e6ec09-9120-48c4-903d-8412155d8f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Volume volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce (6dc82d6b-114c-43cf-aa8a-2de788ba61ce): created successfully Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e6ec09-9120-48c4-903d-8412155d8f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Flow 'volume_create_manager' (cec8214b-e508-43c5-8e81-7533fb415528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f151ed60-b4d2-49f9-88d7-389aa82f184e tempest-TestStampPattern-622553893 None] Created volume successfully. Sep 25 12:59:27 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:27 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:42 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:47 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 12:59:47 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:47 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.338s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:59:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:00:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-ec9cbaac-b262-49dc-bd76-002658a84fc8 req-a3ba961e-9a96-4d91-949f-6d606d6cfa51 tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-ec9cbaac-b262-49dc-bd76-002658a84fc8 req-a3ba961e-9a96-4d91-949f-6d606d6cfa51 tempest-TestStampPattern-622553893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [req-ec9cbaac-b262-49dc-bd76-002658a84fc8 req-a3ba961e-9a96-4d91-949f-6d606d6cfa51 tempest-TestStampPattern-622553893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-ec9cbaac-b262-49dc-bd76-002658a84fc8 req-a3ba961e-9a96-4d91-949f-6d606d6cfa51 tempest-TestStampPattern-622553893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0', 'name': 'volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '789c253a-1a65-4d0a-898e-8625c42a0cfb', 'enforce_multipath': True} {{(pid=87094) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:00:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-ec9cbaac-b262-49dc-bd76-002658a84fc8 req-a3ba961e-9a96-4d91-949f-6d606d6cfa51 tempest-TestStampPattern-622553893 None] attachment_update completed successfully. Sep 25 13:00:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [req-fb23af48-8590-4f55-a0d8-e8cf2160aeb1 req-ac4ad68a-bf27-413a-b17d-fa2c402895f4 tempest-TestStampPattern-622553893 None] Terminate volume connection completed successfully. Sep 25 13:00:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [req-fb23af48-8590-4f55-a0d8-e8cf2160aeb1 req-ac4ad68a-bf27-413a-b17d-fa2c402895f4 tempest-TestStampPattern-622553893 None] Deleting attachment 789c253a-1a65-4d0a-898e-8625c42a0cfb. {{(pid=87094) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:00:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-6dc82d6b-114c-43cf-aa8a-2de788ba61ce-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "cinder-6dc82d6b-114c-43cf-aa8a-2de788ba61ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac556e31-d540-4d98-8dc3-40d17d3bbe5f]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:10 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce Sep 25 13:00:10 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:10 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" returned: 0 in 0.422s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:10 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce Sep 25 13:00:10 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:10 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" returned: 0 in 0.293s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-6dc82d6b-114c-43cf-aa8a-2de788ba61ce" released by "delete_volume" :: held 0.762s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Created reservations ['76ad8dfa-2a5d-4c3f-908a-bbe989f79a55', 'a8786ca2-690e-4dc6-aed8-17d0dd8efc39', '59bc10c1-9cf5-4fec-b740-0cba3395bc34', 'a3c45087-2d02-431a-a463-79091d8d6ea0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:10 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:10 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:11 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.296s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Deleted volume successfully. Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e435cef7-9371-49f4-aa07-bf7c51830e9d tempest-TestStampPattern-622553893 None] Lock "cinder-6dc82d6b-114c-43cf-aa8a-2de788ba61ce-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-e9795704-ed91-46cf-995c-674b76287721-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-e9795704-ed91-46cf-995c-674b76287721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Deleting offline snapshot e9795704-ed91-46cf-995c-674b76287721 of volume 637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] snapshot_file for this snap is: volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf5029f-fc00-4694-a594-e2bcdef073f7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:11 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 13:00:11 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:11 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637526f4-40af-4544-b5f9-57c70c1ebb6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:00:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[193fe028-1cad-4a8c-b6ae-9ef8f97fa2d9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:12 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 13:00:12 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:12 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.641s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:12 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 13:00:12 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.506s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:13 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721 Sep 25 13:00:13 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f.e9795704-ed91-46cf-995c-674b76287721" returned: 0 in 0.335s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-e9795704-ed91-46cf-995c-674b76287721" released by "_delete_snapshot" :: held 2.009s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" released by "delete_snapshot" :: held 2.034s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Created reservations ['b68b5e7d-6095-4229-ae05-ddeb2722a320', '2b3f16e2-836b-40a3-883c-a3c8b208832e', '085ecded-048d-4567-aae8-8932674024bb', 'c85c8257-d266-41ae-90ef-97c892419828'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Delete snapshot completed successfully. Sep 25 13:00:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-898acbaa-a4b8-44c1-985e-c146ca076078 tempest-TestStampPattern-622553893 None] Lock "cinder-e9795704-ed91-46cf-995c-674b76287721-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-637526f4-40af-4544-b5f9-57c70c1ebb6f-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "cinder-637526f4-40af-4544-b5f9-57c70c1ebb6f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Acquiring lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c89d86-a74c-41fe-816a-7eeb3220dce3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:18 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 13:00:18 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:19 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.428s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:19 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f Sep 25 13:00:19 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:19 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-637526f4-40af-4544-b5f9-57c70c1ebb6f" returned: 0 in 0.326s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "cinder-quobyte-637526f4-40af-4544-b5f9-57c70c1ebb6f" released by "delete_volume" :: held 0.827s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Created reservations ['aba8a825-dab3-4e8e-ac2c-8ccbb4af36fe', '0b2499af-6ee8-4131-807b-8b5689899d06', '1f41bbfa-3164-42a7-b6cd-492ca0b3381b', '91786d6c-7de9-404b-8481-a616aae0764d'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:19 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:19 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:19 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.325s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:19 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Deleted volume successfully. Sep 25 13:00:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-07857665-cc8f-424e-ae14-6708d6764f3a tempest-TestStampPattern-622553893 None] Lock "cinder-637526f4-40af-4544-b5f9-57c70c1ebb6f-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:29 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:00:30 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Flow 'volume_create_manager' (dbf95cf1-0b5c-4b78-a765-7e4923978fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31d35f1-bf07-456a-9911-ed05a62db570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31d35f1-bf07-456a-9911-ed05a62db570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f114c79-f30b-4fd2-81c2-677afb0f6168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c552bd3b24138b7a88f97048728c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:37Z,use_quota=True,user_id='cc2b40514f6044a4b734e2344ff7240a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442a61e-dac3-40ae-9baa-6c7b02bea0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442a61e-dac3-40ae-9baa-6c7b02bea0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f733b6b-2994-4ada-a501-93d3c01d55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:36 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f733b6b-2994-4ada-a501-93d3c01d55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f114c79-f30b-4fd2-81c2-677afb0f6168', 'volume_name': 'volume-9f114c79-f30b-4fd2-81c2-677afb0f6168', 'volume_size': 1, 'image_id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ff4ae3ba225a3d421ec90414887098b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c552bd3b24138b7a88f97048728c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c6293481a60094a21c903110a56d068b8d8f63fb4d382c4a783860eb9b5e7440255412a791768d7363ff8152704b1b2be2ed7d648935a2d31c160ed442e2bbb', 'id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'created_at': datetime.datetime(2026, 9, 25, 11, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235feed0-a4d2-40c0-aed9-f3559dc6cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235feed0-a4d2-40c0-aed9-f3559dc6cb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5cc4c9-c23a-4cbc-8c87-2ca8ed1ec430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Volume 9f114c79-f30b-4fd2-81c2-677afb0f6168: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f114c79-f30b-4fd2-81c2-677afb0f6168', 'volume_size': 1, 'image_id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ff4ae3ba225a3d421ec90414887098b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c552bd3b24138b7a88f97048728c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c6293481a60094a21c903110a56d068b8d8f63fb4d382c4a783860eb9b5e7440255412a791768d7363ff8152704b1b2be2ed7d648935a2d31c160ed442e2bbb', 'id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'created_at': datetime.datetime(2026, 9, 25, 11, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1/file', 'properties': {}}, 'image_service': } Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Trying to clone 9f114c79-f30b-4fd2-81c2-677afb0f6168 from image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:00:37 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc77ab17-1910-45e2-96a7-ea1bc4b4d391]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:37 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:37 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:37 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:37 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:37 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:38 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Temporary image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 is fetched for user cc2b40514f6044a4b734e2344ff7240a. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca7f24-d7ec-41ff-a05a-a9b06373617a]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:38 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:38 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:38 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:38 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:38 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:38 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f114c79-f30b-4fd2-81c2-677afb0f6168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c552bd3b24138b7a88f97048728c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:37Z,use_quota=True,user_id='cc2b40514f6044a4b734e2344ff7240a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Creating volume 9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:38 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:00:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:38 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1073741824 Sep 25 13:00:38 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:39 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1073741824" returned: 0 in 0.557s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:39 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 Sep 25 13:00:39 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:39 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168" returned: 0 in 0.302s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Attempting download of 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}])) to volume 9f114c79-f30b-4fd2-81c2-677afb0f6168. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df086dc-c98e-4a12-8b31-7d42f902e7ad]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:40 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq Sep 25 13:00:40 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:40 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq" returned: 0 in 0.414s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:40 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq Sep 25 13:00:40 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:40 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq" returned: 1 in 0.385s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_8zc5ftsq' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d02915-4979-4924-8524-f49fc2bd9560]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:40 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:40 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:41 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:41 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD Sep 25 13:00:41 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:41 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 was raw, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:00:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:41 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 Sep 25 13:00:41 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:42 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168" returned: 0 in 0.542s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95b4bd00-aae9-4d18-af56-f9e9f2f231c1_cexjpfn7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:00:42 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:42 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1G Sep 25 13:00:42 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:42 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 1G" returned: 0 in 0.348s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Downloaded image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}])) to volume 9f114c79-f30b-4fd2-81c2-677afb0f6168 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Temporary image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 for user cc2b40514f6044a4b734e2344ff7240a is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Marking volume 9f114c79-f30b-4fd2-81c2-677afb0f6168 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Copying metadata from image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 to 9f114c79-f30b-4fd2-81c2-677afb0f6168. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Creating volume glance metadata for volume 9f114c79-f30b-4fd2-81c2-677afb0f6168 backed by image 95b4bd00-aae9-4d18-af56-f9e9f2f231c1 with: {'image_id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6ff4ae3ba225a3d421ec90414887098b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5cc4c9-c23a-4cbc-8c87-2ca8ed1ec430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f114c79-f30b-4fd2-81c2-677afb0f6168', 'volume_size': 1, 'image_id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ff4ae3ba225a3d421ec90414887098b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c552bd3b24138b7a88f97048728c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c6293481a60094a21c903110a56d068b8d8f63fb4d382c4a783860eb9b5e7440255412a791768d7363ff8152704b1b2be2ed7d648935a2d31c160ed442e2bbb', 'id': '95b4bd00-aae9-4d18-af56-f9e9f2f231c1', 'created_at': datetime.datetime(2026, 9, 25, 11, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b4bd00-aae9-4d18-af56-f9e9f2f231c1/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd7835f-8191-42df-afe1-c60941413dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Volume volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 (9f114c79-f30b-4fd2-81c2-677afb0f6168): created successfully Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd7835f-8191-42df-afe1-c60941413dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Flow 'volume_create_manager' (dbf95cf1-0b5c-4b78-a765-7e4923978fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8a26e9a9-75c5-4672-a471-4f4d1fd011b0 tempest-VolumeImageDependencyTests-1317397393 None] Created volume successfully. Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Acquiring lock "cinder-9f114c79-f30b-4fd2-81c2-677afb0f6168-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "cinder-9f114c79-f30b-4fd2-81c2-677afb0f6168-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Acquiring lock "cinder-quobyte-9f114c79-f30b-4fd2-81c2-677afb0f6168" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "cinder-quobyte-9f114c79-f30b-4fd2-81c2-677afb0f6168" acquired by "delete_volume" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9360aed2-2a54-48cb-a82d-47579b17af93]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:43 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 Sep 25 13:00:43 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:43 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:43 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168 Sep 25 13:00:43 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:44 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-9f114c79-f30b-4fd2-81c2-677afb0f6168" returned: 0 in 0.323s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "cinder-quobyte-9f114c79-f30b-4fd2-81c2-677afb0f6168" released by "delete_volume" :: held 0.787s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Created reservations ['26543802-17ed-44fd-8e5a-2977d1877d36', '8ddaefd3-cc78-41ee-bbe6-89a83b445a1a', '554cc379-96c9-47e7-8d52-9da4ea6e3652', 'c08c3a33-a0e5-4fab-bcfe-a670661713ec'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:44 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:44 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:44 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.330s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Deleted volume successfully. Sep 25 13:00:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-99b325aa-cec8-4308-b535-e6e50c3e2dca tempest-VolumeImageDependencyTests-1317397393 None] Lock "cinder-9f114c79-f30b-4fd2-81c2-677afb0f6168-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:47 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:47 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:47 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.310s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:00:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (f8fd85b7-9b02-4d4e-ac09-856ea0f9540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6389afb7-6d10-4690-9077-a022559f5145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6389afb7-6d10-4690-9077-a022559f5145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389111363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad61ad94-69a0-4c44-990f-9305324008c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:49Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b8075d-d77d-4c3d-8497-0fcc95659421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b8075d-d77d-4c3d-8497-0fcc95659421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb048ce-541c-4b0a-832d-d107b636f992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb048ce-541c-4b0a-832d-d107b636f992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad61ad94-69a0-4c44-990f-9305324008c7', 'volume_name': 'volume-ad61ad94-69a0-4c44-990f-9305324008c7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc209c61-8e38-4cb6-9db7-e06f7613de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc209c61-8e38-4cb6-9db7-e06f7613de2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d703dd-bfb1-4ec6-a3df-547d31a1d97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Volume ad61ad94-69a0-4c44-990f-9305324008c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad61ad94-69a0-4c44-990f-9305324008c7', 'volume_size': 1} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389111363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad61ad94-69a0-4c44-990f-9305324008c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:49Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Creating volume ad61ad94-69a0-4c44-990f-9305324008c7 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:49 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:49 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 1073741824 Sep 25 13:00:49 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:49 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 1073741824" returned: 0 in 0.467s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:49 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 Sep 25 13:00:49 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:50 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7" returned: 0 in 0.291s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d703dd-bfb1-4ec6-a3df-547d31a1d97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad61ad94-69a0-4c44-990f-9305324008c7', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93273bda-586f-4cc5-8fd1-4419e8a920da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Volume volume-ad61ad94-69a0-4c44-990f-9305324008c7 (ad61ad94-69a0-4c44-990f-9305324008c7): created successfully Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93273bda-586f-4cc5-8fd1-4419e8a920da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (f8fd85b7-9b02-4d4e-ac09-856ea0f9540f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-31c43a7d-0471-4456-acb0-eba6601e4741 tempest-ProjectReaderTests-307429931 None] Created volume successfully. Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-ad61ad94-69a0-4c44-990f-9305324008c7-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "cinder-ad61ad94-69a0-4c44-990f-9305324008c7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-quobyte-ad61ad94-69a0-4c44-990f-9305324008c7" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-ad61ad94-69a0-4c44-990f-9305324008c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c78aada-abe3-497b-8057-9d4a8bfd5ee6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:51 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 Sep 25 13:00:51 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:52 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7" returned: 0 in 0.384s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:52 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7 Sep 25 13:00:52 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:52 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ad61ad94-69a0-4c44-990f-9305324008c7" returned: 0 in 0.270s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-ad61ad94-69a0-4c44-990f-9305324008c7" released by "delete_volume" :: held 0.704s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Created reservations ['e7c40dca-fae0-486a-beef-9e420ba33f01', '15355b3e-aaf0-48f4-80a5-afa627a3d173', 'ab88773c-4049-4844-af58-2e51c3f9d834', 'a6cbc44b-6ffb-47bb-922c-596e777ea084'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:52 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:52 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:52 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.281s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:52 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Deleted volume successfully. Sep 25 13:00:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8baa8408-8a04-4238-b41e-69f675e0108d tempest-ProjectReaderTests-307429931 None] Lock "cinder-ad61ad94-69a0-4c44-990f-9305324008c7-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (346eab41-cbce-4cf2-997a-0d816497497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528373ae-64d4-49d8-9b67-e06297331848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528373ae-64d4-49d8-9b67-e06297331848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780243701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956c7052-831f-4629-a456-7c5fd83104f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:53Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7127d7b-6381-4149-a0b6-19471154a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7127d7b-6381-4149-a0b6-19471154a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172bd910-2acd-4ef2-8957-53f47853da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172bd910-2acd-4ef2-8957-53f47853da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956c7052-831f-4629-a456-7c5fd83104f4', 'volume_name': 'volume-956c7052-831f-4629-a456-7c5fd83104f4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b7e2e8-670d-4b19-a785-3dddb42386f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b7e2e8-670d-4b19-a785-3dddb42386f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a8bdc-c471-4b9e-9843-ddff1c713730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Volume 956c7052-831f-4629-a456-7c5fd83104f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956c7052-831f-4629-a456-7c5fd83104f4', 'volume_size': 1} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780243701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956c7052-831f-4629-a456-7c5fd83104f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:53Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Creating volume 956c7052-831f-4629-a456-7c5fd83104f4 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:53 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:53 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 1073741824 Sep 25 13:00:53 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:53 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 1073741824" returned: 0 in 0.465s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:53 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 Sep 25 13:00:53 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:54 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4" returned: 0 in 0.258s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a8bdc-c471-4b9e-9843-ddff1c713730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956c7052-831f-4629-a456-7c5fd83104f4', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323afd6c-d4b4-438e-b8b0-950b262971ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:54 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Volume volume-956c7052-831f-4629-a456-7c5fd83104f4 (956c7052-831f-4629-a456-7c5fd83104f4): created successfully Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323afd6c-d4b4-438e-b8b0-950b262971ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (346eab41-cbce-4cf2-997a-0d816497497c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-64706415-870a-4f16-8578-7040fa678a58 tempest-ProjectReaderTests-307429931 None] Created volume successfully. Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-956c7052-831f-4629-a456-7c5fd83104f4-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "cinder-956c7052-831f-4629-a456-7c5fd83104f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-quobyte-956c7052-831f-4629-a456-7c5fd83104f4" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-956c7052-831f-4629-a456-7c5fd83104f4" acquired by "delete_volume" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e441b5c-5667-4fba-b8ee-d6cba4f457e8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:55 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 Sep 25 13:00:55 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:55 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4" returned: 0 in 0.400s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:55 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4 Sep 25 13:00:55 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:56 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-956c7052-831f-4629-a456-7c5fd83104f4" returned: 0 in 0.282s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-956c7052-831f-4629-a456-7c5fd83104f4" released by "delete_volume" :: held 0.731s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Created reservations ['c2799017-6b9c-43d4-b39a-c0a721afe2c6', 'ea4ed1bb-5b7a-487c-a958-db69213eaf82', '01a74e85-d5ca-4e65-8471-ab4fc1ddc3ef', '16a7d04d-b873-4f99-bba2-0b2a73291d37'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:56 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:00:56 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:56 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Deleted volume successfully. Sep 25 13:00:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93986426-49c4-4285-a888-90671971c413 tempest-ProjectReaderTests-307429931 None] Lock "cinder-956c7052-831f-4629-a456-7c5fd83104f4-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (41736e91-cba6-4623-9d1d-982d62c80ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95dcd1-1045-4070-ae81-4846b0abd1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95dcd1-1045-4070-ae81-4846b0abd1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93296310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521fd58d-2abe-409f-953c-f3b6460e77d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:57Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b232d062-5a0a-47cd-89da-d27d735e0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b232d062-5a0a-47cd-89da-d27d735e0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4aa8b2-4522-4014-a668-32e0a9987b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4aa8b2-4522-4014-a668-32e0a9987b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521fd58d-2abe-409f-953c-f3b6460e77d0', 'volume_name': 'volume-521fd58d-2abe-409f-953c-f3b6460e77d0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3ccd3d-8038-4138-808e-f12c8204c5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3ccd3d-8038-4138-808e-f12c8204c5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e5154a-91af-4d01-90c1-1965e9b39da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Volume 521fd58d-2abe-409f-953c-f3b6460e77d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521fd58d-2abe-409f-953c-f3b6460e77d0', 'volume_size': 1} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93296310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521fd58d-2abe-409f-953c-f3b6460e77d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:57Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Creating volume 521fd58d-2abe-409f-953c-f3b6460e77d0 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:57 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:57 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 1073741824 Sep 25 13:00:57 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:57 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 1073741824" returned: 0 in 0.531s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:57 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 Sep 25 13:00:57 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:58 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e5154a-91af-4d01-90c1-1965e9b39da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521fd58d-2abe-409f-953c-f3b6460e77d0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e36eab8-d009-4a1f-8121-fccdddfc2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Volume volume-521fd58d-2abe-409f-953c-f3b6460e77d0 (521fd58d-2abe-409f-953c-f3b6460e77d0): created successfully Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e36eab8-d009-4a1f-8121-fccdddfc2221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (41736e91-cba6-4623-9d1d-982d62c80ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e232b3b9-b3c0-421e-b559-672742931afb tempest-ProjectReaderTests-307429931 None] Created volume successfully. Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-521fd58d-2abe-409f-953c-f3b6460e77d0-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "cinder-521fd58d-2abe-409f-953c-f3b6460e77d0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-quobyte-521fd58d-2abe-409f-953c-f3b6460e77d0" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-521fd58d-2abe-409f-953c-f3b6460e77d0" acquired by "delete_volume" :: waited 0.014s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac62ab8-8a86-4b99-becb-b4509fc6cca6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:59 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 Sep 25 13:00:59 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:59 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0" returned: 0 in 0.399s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:59 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0 Sep 25 13:00:59 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:00 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-521fd58d-2abe-409f-953c-f3b6460e77d0" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-521fd58d-2abe-409f-953c-f3b6460e77d0" released by "delete_volume" :: held 0.745s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Created reservations ['683c14d8-96ff-4287-a1ae-0fe64387431f', '7f5dec98-7d40-4b25-9613-f78d39e643d4', '882409a1-29a3-4730-a23c-1a1f7e56beea', '2954a229-5b72-4e15-a5f3-19c976950456'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:00 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:00 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:00 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.289s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:00 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Deleted volume successfully. Sep 25 13:01:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-117bce50-7cd0-46a4-bb1a-def902de9677 tempest-ProjectReaderTests-307429931 None] Lock "cinder-521fd58d-2abe-409f-953c-f3b6460e77d0-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (a69adf31-309c-4eea-9c44-b458a394b0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0816a4da-60ec-43bb-9800-65aeaba7694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0816a4da-60ec-43bb-9800-65aeaba7694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754194446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff23c57-5541-4aba-922f-d3dcfce2009e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:01Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f09aedc-5ff1-47fb-b06d-3fab469abb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f09aedc-5ff1-47fb-b06d-3fab469abb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1fa296-9210-4c0c-9222-ea955d674823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1fa296-9210-4c0c-9222-ea955d674823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff23c57-5541-4aba-922f-d3dcfce2009e', 'volume_name': 'volume-1ff23c57-5541-4aba-922f-d3dcfce2009e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d897cfc-0f79-49c9-b2b6-1537042cffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d897cfc-0f79-49c9-b2b6-1537042cffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb83d80-e530-4bd8-a453-98dfe0950b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:01 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Volume 1ff23c57-5541-4aba-922f-d3dcfce2009e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff23c57-5541-4aba-922f-d3dcfce2009e', 'volume_size': 1} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754194446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff23c57-5541-4aba-922f-d3dcfce2009e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d7945d769a4cb38c4683394ce1d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:01Z,use_quota=True,user_id='674594204b0149f1a844b72d6095c72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Creating volume 1ff23c57-5541-4aba-922f-d3dcfce2009e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:01 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:01 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e 1073741824 Sep 25 13:01:01 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:01 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e 1073741824" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:01 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e Sep 25 13:01:01 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:02 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e" returned: 0 in 0.281s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb83d80-e530-4bd8-a453-98dfe0950b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff23c57-5541-4aba-922f-d3dcfce2009e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69236fb6-13f0-45b7-86f8-b77f43e9ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:02 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Volume volume-1ff23c57-5541-4aba-922f-d3dcfce2009e (1ff23c57-5541-4aba-922f-d3dcfce2009e): created successfully Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69236fb6-13f0-45b7-86f8-b77f43e9ff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Flow 'volume_create_manager' (a69adf31-309c-4eea-9c44-b458a394b0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bea4ecba-d521-4dde-b605-402292745f84 tempest-ProjectReaderTests-307429931 None] Created volume successfully. Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-1ff23c57-5541-4aba-922f-d3dcfce2009e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "cinder-1ff23c57-5541-4aba-922f-d3dcfce2009e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Acquiring lock "cinder-quobyte-1ff23c57-5541-4aba-922f-d3dcfce2009e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-1ff23c57-5541-4aba-922f-d3dcfce2009e" acquired by "delete_volume" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf707d2-c453-46f0-a637-d527518fd247]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:02 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e Sep 25 13:01:02 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:02 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e" returned: 0 in 0.399s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:02 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e Sep 25 13:01:02 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:03 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1ff23c57-5541-4aba-922f-d3dcfce2009e" returned: 0 in 0.263s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "cinder-quobyte-1ff23c57-5541-4aba-922f-d3dcfce2009e" released by "delete_volume" :: held 0.705s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Created reservations ['d3a476ab-260a-4c33-92cc-de54f2969bc4', 'e1b07a5c-32fe-486d-8fb0-c8e660a9d04f', 'fa2f48aa-2ab5-46b5-b3b8-3f19b3d7a501', '0f7f481b-abb3-4fe1-af31-23b45beb886c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:03 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:03 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:03 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.310s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Deleted volume successfully. Sep 25 13:01:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4bf3043d-c3e5-4289-978b-797aab9c6e14 tempest-ProjectReaderTests-307429931 None] Lock "cinder-1ff23c57-5541-4aba-922f-d3dcfce2009e-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:13 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=56,cinder:SELECT=37,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:01:13 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (b2f708e0-e9ad-472c-ba6c-0a39ae5aa0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028cd739-e412-475f-9d22-960e65a74471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028cd739-e412-475f-9d22-960e65a74471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423835101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1066e7-8a72-4ab7-8186-05997797f90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:17Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866f83ea-7103-44e2-9c73-6f05c9d6589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866f83ea-7103-44e2-9c73-6f05c9d6589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2574b33-55ad-4331-b7ec-5fbae6080888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2574b33-55ad-4331-b7ec-5fbae6080888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1066e7-8a72-4ab7-8186-05997797f90e', 'volume_name': 'volume-8d1066e7-8a72-4ab7-8186-05997797f90e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818e4462-9079-4f98-bb87-e046414f08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818e4462-9079-4f98-bb87-e046414f08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f2745-7b09-45be-9f8e-fb2fb7025284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:17 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume 8d1066e7-8a72-4ab7-8186-05997797f90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1066e7-8a72-4ab7-8186-05997797f90e', 'volume_size': 1} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423835101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1066e7-8a72-4ab7-8186-05997797f90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:17Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume 8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:17 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:17 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e 1073741824 Sep 25 13:01:17 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Flow 'volume_create_manager' (8b79e9eb-fc27-46d6-b3a1-41d818775565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec27949-bcaa-4a08-bce9-b98e42e1bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec27949-bcaa-4a08-bce9-b98e42e1bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129141636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f396c035-e9d3-49a8-b544-cf3ac1def81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9bce596ffc540dca439e125c897c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:18Z,use_quota=True,user_id='6828be985ef44cd6b6255d70f8407019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef14cb1-d6c0-4a2a-b702-77ba86517bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef14cb1-d6c0-4a2a-b702-77ba86517bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8ad7b5-311d-41dc-8dc2-fd6e081b66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8ad7b5-311d-41dc-8dc2-fd6e081b66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f396c035-e9d3-49a8-b544-cf3ac1def81c', 'volume_name': 'volume-f396c035-e9d3-49a8-b544-cf3ac1def81c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a86b557-ba7f-4961-972a-c5571f6c69dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a86b557-ba7f-4961-972a-c5571f6c69dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15fb96a-8d98-4200-9eff-74daa7c00194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Volume f396c035-e9d3-49a8-b544-cf3ac1def81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f396c035-e9d3-49a8-b544-cf3ac1def81c', 'volume_size': 1} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (b7fe6112-1960-4536-92c3-6b436e706487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adeadebc-fd4f-4c84-b5b9-c063d044891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adeadebc-fd4f-4c84-b5b9-c063d044891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2145780011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d185883e-392a-4910-ab97-9d79b913ba62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:18Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91a8185-8e86-4edf-915e-095ac0f14b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91a8185-8e86-4edf-915e-095ac0f14b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0b22d5-e6f7-48e5-bd7c-83ba76bbc3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0b22d5-e6f7-48e5-bd7c-83ba76bbc3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd185883e-392a-4910-ab97-9d79b913ba62', 'volume_name': 'volume-d185883e-392a-4910-ab97-9d79b913ba62', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2358352e-c860-4b8a-a433-9ea2216f70db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2358352e-c860-4b8a-a433-9ea2216f70db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dd061b-9c78-41d5-817c-752b76a5178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Volume d185883e-392a-4910-ab97-9d79b913ba62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d185883e-392a-4910-ab97-9d79b913ba62', 'volume_size': 1} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:18 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e 1073741824" returned: 0 in 0.964s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:18 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e Sep 25 13:01:18 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (d452ad88-dbb3-482e-8324-22f30d33b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a43732-3e0b-42a2-9494-708b8fcebc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a43732-3e0b-42a2-9494-708b8fcebc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108687820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77aa1b1-da2c-4e45-9d3e-7290beadf14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:19Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd162c-116f-4ecc-ab05-f2b8d9dc3a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd162c-116f-4ecc-ab05-f2b8d9dc3a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a8dc06-9213-4460-95d5-ddabc15d208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a8dc06-9213-4460-95d5-ddabc15d208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77aa1b1-da2c-4e45-9d3e-7290beadf14b', 'volume_name': 'volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bdb12-930c-4b8c-bed7-8a3ebc240eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bdb12-930c-4b8c-bed7-8a3ebc240eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7d5e52-2f40-455f-b560-a3f043b61de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Volume e77aa1b1-da2c-4e45-9d3e-7290beadf14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b', 'volume_size': 1} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:18 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129141636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f396c035-e9d3-49a8-b544-cf3ac1def81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9bce596ffc540dca439e125c897c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:18Z,use_quota=True,user_id='6828be985ef44cd6b6255d70f8407019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Creating volume f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:18 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7f2745-7b09-45be-9f8e-fb2fb7025284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1066e7-8a72-4ab7-8186-05997797f90e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a628c9-fc6a-4c20-983e-790672e2d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:18 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c 1073741824 Sep 25 13:01:18 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-8d1066e7-8a72-4ab7-8186-05997797f90e (8d1066e7-8a72-4ab7-8186-05997797f90e): created successfully Sep 25 13:01:18 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a628c9-fc6a-4c20-983e-790672e2d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:18 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (b2f708e0-e9ad-472c-ba6c-0a39ae5aa0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:19 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a739cb85-6304-465b-8471-cd48d331049c tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (2b033da5-514f-4b5e-9bc4-85f51ea918f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc17376b-dccf-4b7a-83e1-946656c82077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc17376b-dccf-4b7a-83e1-946656c82077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604507632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7bc33d-0ef4-4ebe-a796-27d7c2981e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:19Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74bb564-5ece-4220-96e1-b4348089997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74bb564-5ece-4220-96e1-b4348089997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4316b4c-8353-4dfc-bff2-e1b1f77b2d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4316b4c-8353-4dfc-bff2-e1b1f77b2d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7bc33d-0ef4-4ebe-a796-27d7c2981e29', 'volume_name': 'volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ebe879-78ff-42db-8a76-9cc6af344888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ebe879-78ff-42db-8a76-9cc6af344888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09895d5a-249e-4ff5-b09f-86ee9f3c8b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Volume 3b7bc33d-0ef4-4ebe-a796-27d7c2981e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29', 'volume_size': 1} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:19 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c 1073741824" returned: 0 in 0.606s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:19 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:19 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (f1188fe5-9e6f-4c72-a9e4-3f693bb2201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ea358b-f014-4f93-be17-4df2991d5cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ea358b-f014-4f93-be17-4df2991d5cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003522151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c40401d-c212-4f7a-aebf-446cfba2439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:20Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a68a16-8fcf-4b9d-a709-6dbea4e181f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a68a16-8fcf-4b9d-a709-6dbea4e181f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cd89cb-2df8-4aa9-a52f-a3320eadb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cd89cb-2df8-4aa9-a52f-a3320eadb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c40401d-c212-4f7a-aebf-446cfba2439e', 'volume_name': 'volume-3c40401d-c212-4f7a-aebf-446cfba2439e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d168a86e-2b5b-45b8-96fd-071d1640ae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d168a86e-2b5b-45b8-96fd-071d1640ae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1fffeb-4b7b-46f6-9c9f-97403f50fcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Volume 3c40401d-c212-4f7a-aebf-446cfba2439e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c40401d-c212-4f7a-aebf-446cfba2439e', 'volume_size': 1} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:19 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2145780011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d185883e-392a-4910-ab97-9d79b913ba62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:18Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Creating volume d185883e-392a-4910-ab97-9d79b913ba62 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:20 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:20 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 1073741824 Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15fb96a-8d98-4200-9eff-74daa7c00194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f396c035-e9d3-49a8-b544-cf3ac1def81c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8cf8a6-1235-4c5c-ae81-5ea21247504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Volume volume-f396c035-e9d3-49a8-b544-cf3ac1def81c (f396c035-e9d3-49a8-b544-cf3ac1def81c): created successfully Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8cf8a6-1235-4c5c-ae81-5ea21247504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Flow 'volume_create_manager' (8b79e9eb-fc27-46d6-b3a1-41d818775565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-edd7ab18-d346-436a-92ce-3c00bd394850 tempest-VolumeDependencyTests-1674013013 None] Created volume successfully. Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (0ad1af6b-9ff5-4882-bbbe-85a404a4c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727dc1fd-9911-4d87-b1da-453e0d05111c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727dc1fd-9911-4d87-b1da-453e0d05111c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854287195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2802d7f7-e195-4606-be2f-065b43d9a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:20Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543b100-fc54-4ef2-be83-87eff0f4e103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1543b100-fc54-4ef2-be83-87eff0f4e103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51611242-a1ac-41b8-b30b-2baf44105801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51611242-a1ac-41b8-b30b-2baf44105801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2802d7f7-e195-4606-be2f-065b43d9a4af', 'volume_name': 'volume-2802d7f7-e195-4606-be2f-065b43d9a4af', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3fcde8-10c6-482d-8bb2-3a9055078496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3fcde8-10c6-482d-8bb2-3a9055078496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a208bdf-815e-4a08-988b-efd617d212d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Volume 2802d7f7-e195-4606-be2f-065b43d9a4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2802d7f7-e195-4606-be2f-065b43d9a4af', 'volume_size': 1} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:20 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 1073741824" returned: 0 in 0.615s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:20 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 Sep 25 13:01:20 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:20 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108687820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77aa1b1-da2c-4e45-9d3e-7290beadf14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:19Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Creating volume e77aa1b1-da2c-4e45-9d3e-7290beadf14b {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:20 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dd061b-9c78-41d5-817c-752b76a5178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d185883e-392a-4910-ab97-9d79b913ba62', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965dadac-bfb3-484d-9037-6947ec3c6c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:21 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b 1073741824 Sep 25 13:01:21 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Volume volume-d185883e-392a-4910-ab97-9d79b913ba62 (d185883e-392a-4910-ab97-9d79b913ba62): created successfully Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965dadac-bfb3-484d-9037-6947ec3c6c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (b7fe6112-1960-4536-92c3-6b436e706487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a19f1857-f0db-486e-8aa1-279bee1e200a tempest-CreateVolumesFromImageTest-174654178 None] Created volume successfully. Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:21 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b 1073741824" returned: 0 in 0.577s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:21 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b Sep 25 13:01:21 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:21 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" returned: 0 in 0.287s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604507632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7bc33d-0ef4-4ebe-a796-27d7c2981e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:19Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Creating volume 3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:21 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7d5e52-2f40-455f-b560-a3f043b61de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512a1f57-313c-4a6e-8dc8-17b2a9defc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:21 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 1073741824 Sep 25 13:01:21 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Volume volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b (e77aa1b1-da2c-4e45-9d3e-7290beadf14b): created successfully Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512a1f57-313c-4a6e-8dc8-17b2a9defc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (d452ad88-dbb3-482e-8324-22f30d33b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:21 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-67014931-0ea5-4340-af07-a3608d8d4be2 tempest-CreateVolumesFromImageTest-174654178 None] Created volume successfully. Sep 25 13:01:22 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 1073741824" returned: 0 in 0.538s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:22 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 Sep 25 13:01:22 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Flow 'volume_create_manager' (56ea62f2-aa8d-48dd-ae84-68519d2c4dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7343b5-721d-484f-9506-592c9f7acf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7343b5-721d-484f-9506-592c9f7acf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a387463-3175-4bd9-88ac-85be16f72910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f5b65634f64600b2dac338089abe8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:23Z,use_quota=True,user_id='bee696f1dd744b4dac22e269efd4913d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(870b903c-d127-46bc-93ba-92de2b2d06cc),volume_type_id=870b903c-d127-46bc-93ba-92de2b2d06cc)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668c786-3ac4-4bdd-89d9-534628aea00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668c786-3ac4-4bdd-89d9-534628aea00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2e5f6-8a21-480c-b177-17d72bcde90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:01:22 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" returned: 0 in 0.254s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003522151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c40401d-c212-4f7a-aebf-446cfba2439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:20Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Creating volume 3c40401d-c212-4f7a-aebf-446cfba2439e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:22 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:22 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e 1073741824 Sep 25 13:01:22 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09895d5a-249e-4ff5-b09f-86ee9f3c8b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecbe3fe-359c-4054-b9d2-8ecd531515cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Volume volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 (3b7bc33d-0ef4-4ebe-a796-27d7c2981e29): created successfully Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecbe3fe-359c-4054-b9d2-8ecd531515cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (2b033da5-514f-4b5e-9bc4-85f51ea918f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-94d7a522-f03b-4e43-a0f2-dd21632611ea tempest-CreateVolumesFromImageTest-174654178 None] Created volume successfully. Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2e5f6-8a21-480c-b177-17d72bcde90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a387463-3175-4bd9-88ac-85be16f72910', 'volume_name': 'volume-4a387463-3175-4bd9-88ac-85be16f72910', 'volume_size': 1, 'image_id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92cadb9a2990f12df9166ac100738827', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4f5b65634f64600b2dac338089abe8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '041d3debcaff8a22972e65cc83541091736af4c6793f24fd0fc16c53e87685bbb04508f00176748c73f94569add45517c10d6e0f4ef95a5f6ff5e251c3af7ff5', 'id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'created_at': datetime.datetime(2026, 9, 25, 11, 1, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 1, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23387a5e-f861-420f-92aa-654ceb3ce012/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1c570b-6377-4b92-a33e-23a0573c1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1c570b-6377-4b92-a33e-23a0573c1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4d6721-9028-4f78-a935-03b4c7690e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Volume 4a387463-3175-4bd9-88ac-85be16f72910: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a387463-3175-4bd9-88ac-85be16f72910', 'volume_size': 1, 'image_id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92cadb9a2990f12df9166ac100738827', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4f5b65634f64600b2dac338089abe8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '041d3debcaff8a22972e65cc83541091736af4c6793f24fd0fc16c53e87685bbb04508f00176748c73f94569add45517c10d6e0f4ef95a5f6ff5e251c3af7ff5', 'id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'created_at': datetime.datetime(2026, 9, 25, 11, 1, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 1, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23387a5e-f861-420f-92aa-654ceb3ce012/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 13:01:22 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Trying to clone 4a387463-3175-4bd9-88ac-85be16f72910 from image 23387a5e-f861-420f-92aa-654ceb3ce012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:01:23 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0145bf17-9027-4d06-8b9a-dc708464a77b]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:23 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:23 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:23 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e 1073741824" returned: 0 in 0.527s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:23 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e Sep 25 13:01:23 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:23 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:23 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e" returned: 0 in 0.270s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.299s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854287195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2802d7f7-e195-4606-be2f-065b43d9a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fbaf5956574822a3c8e2a7fbcf651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:20Z,use_quota=True,user_id='3fe1698b895e456ba1d73e11d8ff5edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Creating volume 2802d7f7-e195-4606-be2f-065b43d9a4af {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:23 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:23 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:23 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:23 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af 1073741824 Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1fffeb-4b7b-46f6-9c9f-97403f50fcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c40401d-c212-4f7a-aebf-446cfba2439e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:23 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a1e80f-1c21-4ca9-8881-33b68ab8e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:23 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Volume volume-3c40401d-c212-4f7a-aebf-446cfba2439e (3c40401d-c212-4f7a-aebf-446cfba2439e): created successfully Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a1e80f-1c21-4ca9-8881-33b68ab8e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (f1188fe5-9e6f-4c72-a9e4-3f693bb2201e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:23 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d4d042c5-e83d-42de-a998-d367d5d5c6ec tempest-CreateVolumesFromImageTest-174654178 None] Created volume successfully. Sep 25 13:01:23 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Temporary image 23387a5e-f861-420f-92aa-654ceb3ce012 is fetched for user bee696f1dd744b4dac22e269efd4913d. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9590bfe0-7abd-4382-a39a-7e646376f6d5]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:24 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:24 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:24 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af 1073741824" returned: 0 in 0.481s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:24 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af Sep 25 13:01:24 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:24 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:24 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:24 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:24 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af" returned: 0 in 0.294s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.023s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a208bdf-815e-4a08-988b-efd617d212d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2802d7f7-e195-4606-be2f-065b43d9a4af', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b45ac6-f66a-4cf7-978c-a99397c58a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating offline snapshot d85f1567-92c8-4005-a724-be0bc9993e44 of volume 8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:01:24 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Volume volume-2802d7f7-e195-4606-be2f-065b43d9a4af (2802d7f7-e195-4606-be2f-065b43d9a4af): created successfully Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b45ac6-f66a-4cf7-978c-a99397c58a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Flow 'volume_create_manager' (0ad1af6b-9ff5-4882-bbbe-85a404a4c103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[88774033-26f3-46e5-bed1-c99021eb6252]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:24 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ec50e622-02c8-403c-a507-108c73d586ab tempest-CreateVolumesFromImageTest-174654178 None] Created volume successfully. Sep 25 13:01:24 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e Sep 25 13:01:24 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:24 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:24 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e" returned: 0 in 0.447s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:24 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 1G Sep 25 13:01:24 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:25 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 1G" returned: 0 in 0.429s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1066e7-8a72-4ab7-8186-05997797f90e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:25 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1066e7-8a72-4ab7-8186-05997797f90e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 Sep 25 13:01:25 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-2802d7f7-e195-4606-be2f-065b43d9a4af-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-2802d7f7-e195-4606-be2f-065b43d9a4af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-quobyte-2802d7f7-e195-4606-be2f-065b43d9a4af" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-2802d7f7-e195-4606-be2f-065b43d9a4af" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db8aabb-da31-439d-b482-5ae0bee66059]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:25 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1066e7-8a72-4ab7-8186-05997797f90e -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44" returned: 0 in 0.365s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:25 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 is being set with open permissions: ugo+rw Sep 25 13:01:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:25 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 Sep 25 13:01:25 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:25 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af Sep 25 13:01:25 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44" returned: 0 in 0.281s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info Sep 25 13:01:26 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af Sep 25 13:01:26 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info" returned: 0 in 0.311s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info is being set with open permissions: ugo+rw Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2802d7f7-e195-4606-be2f-065b43d9a4af" returned: 0 in 0.275s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info Sep 25 13:01:26 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-2802d7f7-e195-4606-be2f-065b43d9a4af" released by "delete_volume" :: held 0.727s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Created reservations ['faa80cd6-90f2-4632-b919-cb6d71446169', '68cfd5be-d340-41f9-8118-8cf470197918', 'f4e150dc-5855-42a4-af36-7e589a5a9b49', 'b996c6f7-b229-4134-b854-74b9c709e948'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:26 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.info" returned: 0 in 0.266s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.255s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Creating offline snapshot b87c1a39-680a-4882-b8ad-e322ea67a589 of volume f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:01:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ac75d88e-2680-4fc9-8c6a-43c896122d51 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Create snapshot completed successfully Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[889655e5-d350-49fa-bdf4-ed7040f04924]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-3c40401d-c212-4f7a-aebf-446cfba2439e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-3c40401d-c212-4f7a-aebf-446cfba2439e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-quobyte-3c40401d-c212-4f7a-aebf-446cfba2439e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:26 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:26 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-3c40401d-c212-4f7a-aebf-446cfba2439e" acquired by "delete_volume" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:26 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.339s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Deleted volume successfully. Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2958553d-5f98-47a3-81e5-730d7b5652c9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-188a902d-3c63-4770-8d86-eb3e6187bf7f tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-2802d7f7-e195-4606-be2f-065b43d9a4af-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:27 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e Sep 25 13:01:27 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:27 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.420s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:27 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 1G Sep 25 13:01:27 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:27 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e" returned: 0 in 0.430s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:27 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e Sep 25 13:01:27 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:27 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 1G" returned: 0 in 0.502s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f396c035-e9d3-49a8-b544-cf3ac1def81c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:27 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c40401d-c212-4f7a-aebf-446cfba2439e" returned: 0 in 0.324s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:27 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f396c035-e9d3-49a8-b544-cf3ac1def81c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:27 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-3c40401d-c212-4f7a-aebf-446cfba2439e" released by "delete_volume" :: held 0.821s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Created reservations ['e45a08b2-f608-46b2-9b3a-0a01e8852284', '754a307f-04a9-4faf-ab58-5752bf3ccdc4', '39040244-7498-4aa4-8847-b53b94d2b9dd', '81043db7-c7d5-41a8-a629-758610b80677'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:27 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:27 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:28 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f396c035-e9d3-49a8-b544-cf3ac1def81c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.434s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:28 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 is being set with open permissions: ugo+rw Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:28 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:28 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-quobyte-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c213b06e-289a-4287-8bf8-270e7dec3ee7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:28 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.455s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Deleted volume successfully. Sep 25 13:01:28 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 Sep 25 13:01:28 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28fb0ce9-259c-4336-a96c-a9bbb6060b93 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-3c40401d-c212-4f7a-aebf-446cfba2439e-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (b4fc006a-a25c-4886-932f-0ce9e003cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d84b2b-1ab7-43bf-875a-21d322ca4127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d84b2b-1ab7-43bf-875a-21d322ca4127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438321635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ecf712-c087-4bea-a34d-3bb535d50285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:28Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ddc29-f0e5-4148-ac87-77588b31d8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:28 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ddc29-f0e5-4148-ac87-77588b31d8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006c3e31-0e5c-4efa-a1a7-5fc19600f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006c3e31-0e5c-4efa-a1a7-5fc19600f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ecf712-c087-4bea-a34d-3bb535d50285', 'volume_name': 'volume-e6ecf712-c087-4bea-a34d-3bb535d50285', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d2fafb-d4bf-4572-bf86-38925e385636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d2fafb-d4bf-4572-bf86-38925e385636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136c38e5-d7fe-419f-8033-9a022ac47aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume e6ecf712-c087-4bea-a34d-3bb535d50285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ecf712-c087-4bea-a34d-3bb535d50285', 'volume_size': 1} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.477s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:28 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info Sep 25 13:01:28 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:28 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" returned: 0 in 0.541s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:28 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29 Sep 25 13:01:28 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:28 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (f969cb24-bc9f-4f12-8cf9-2e39af24b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:29 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771fdcab-ab5d-4511-b1ca-7d3ab8abf4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info" returned: 0 in 0.400s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:29 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info is being set with open permissions: ugo+rw Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771fdcab-ab5d-4511-b1ca-7d3ab8abf4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14694783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83137d29-8a35-45d6-83f6-2e180378c1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:29Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3507bea-bca2-4d5f-b419-1fb00a5ce04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3507bea-bca2-4d5f-b419-1fb00a5ce04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c678ee-c2cb-4836-9092-071159dd4bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c678ee-c2cb-4836-9092-071159dd4bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83137d29-8a35-45d6-83f6-2e180378c1fc', 'volume_name': 'volume-83137d29-8a35-45d6-83f6-2e180378c1fc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ddfbc4-ce9b-4288-9597-5fa80fc526e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ddfbc4-ce9b-4288-9597-5fa80fc526e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c848fad-80bc-4e25-8a83-89d87fa4b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume 83137d29-8a35-45d6-83f6-2e180378c1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83137d29-8a35-45d6-83f6-2e180378c1fc', 'volume_size': 1} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:29 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29" released by "delete_volume" :: held 0.998s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Created reservations ['9a6f37ee-aff9-46c3-a277-0778b9cb639a', 'c202fbee-23d9-4623-bb5a-a8c98d065b91', '2a947f49-279d-4bbc-a6f3-b372b2c0bc26', 'c0b3a5a5-9101-430c-a019-d814ce084731'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:29 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.info" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:29 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:29 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a387463-3175-4bd9-88ac-85be16f72910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f5b65634f64600b2dac338089abe8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:23Z,use_quota=True,user_id='bee696f1dd744b4dac22e269efd4913d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(870b903c-d127-46bc-93ba-92de2b2d06cc),volume_type_id=870b903c-d127-46bc-93ba-92de2b2d06cc)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Creating volume 4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:29 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:29 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1073741824 Sep 25 13:01:29 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3b0e16b4-4a3a-4a7a-8a41-be584fd3ff61 tempest-VolumeDependencyTests-1674013013 None] Create snapshot completed successfully Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (948ce03f-a0bc-4a59-92e8-506b47618073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca203517-cdb5-4a0f-9671-2e6875c10433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca203517-cdb5-4a0f-9671-2e6875c10433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368512566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8a0b32-b06e-401c-9a54-62a6490328be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:29Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ca6d0-68e6-4cff-9aed-4881c1730c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ca6d0-68e6-4cff-9aed-4881c1730c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0fd36b-3baf-4763-8364-080a475d3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0fd36b-3baf-4763-8364-080a475d3acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8a0b32-b06e-401c-9a54-62a6490328be', 'volume_name': 'volume-4f8a0b32-b06e-401c-9a54-62a6490328be', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5923c18-b8b6-44a5-b168-8a393da8df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5923c18-b8b6-44a5-b168-8a393da8df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a738ea11-daeb-41a9-ba60-e9383b9cf95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume 4f8a0b32-b06e-401c-9a54-62a6490328be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8a0b32-b06e-401c-9a54-62a6490328be', 'volume_size': 1} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:29 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.432s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Deleted volume successfully. Sep 25 13:01:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-363e9a67-ce5c-497d-9af5-ae78f39834d1 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-3b7bc33d-0ef4-4ebe-a796-27d7c2981e29-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:30 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1073741824" returned: 0 in 0.637s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (40e860fd-330d-415e-8e00-59ace571c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe9ab7b-4a2c-4015-8116-29ce5eaed389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe9ab7b-4a2c-4015-8116-29ce5eaed389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393367878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2479c148-8382-4fc2-9841-b66942357823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:30Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a031b5d9-7607-43e3-ad5a-0ac0108b1166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a031b5d9-7607-43e3-ad5a-0ac0108b1166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dab532b-77a0-47d3-aa86-a1baabe4251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dab532b-77a0-47d3-aa86-a1baabe4251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2479c148-8382-4fc2-9841-b66942357823', 'volume_name': 'volume-2479c148-8382-4fc2-9841-b66942357823', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f787dbd2-5a7a-421a-a558-999d28e76685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f787dbd2-5a7a-421a-a558-999d28e76685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa3f5a9-8607-484a-85c0-d3aee5722348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:30 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume 2479c148-8382-4fc2-9841-b66942357823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2479c148-8382-4fc2-9841-b66942357823', 'volume_size': 1} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:30 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 Sep 25 13:01:30 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-e77aa1b1-da2c-4e45-9d3e-7290beadf14b-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-e77aa1b1-da2c-4e45-9d3e-7290beadf14b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-quobyte-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:30 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910" returned: 0 in 0.431s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f702363-09c6-4e06-b7f2-945d103279b6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.122s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438321635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ecf712-c087-4bea-a34d-3bb535d50285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:28Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume e6ecf712-c087-4bea-a34d-3bb535d50285 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:30 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:30 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 1073741824 Sep 25 13:01:30 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Attempting download of 23387a5e-f861-420f-92aa-654ceb3ce012 ((None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}])) to volume 4a387463-3175-4bd9-88ac-85be16f72910. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f68007-5b35-4905-85fc-36a34fc524b9]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:30 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b Sep 25 13:01:30 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl Sep 25 13:01:31 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (5ff4ba88-a010-4f87-847e-2fb14b4b33e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6612b936-8531-44e7-a640-36f5c1b687f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Flow 'volume_create_manager' (b1d2e8ad-b772-4895-860b-a8a0f960a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea969c1-9a14-4d31-9104-f62f88bd88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6612b936-8531-44e7-a640-36f5c1b687f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212576300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31270f3-78e2-491c-a61c-f7ffab50c38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:31Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c4d862-8b7c-4e13-81c4-dc1e14ccc405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c4d862-8b7c-4e13-81c4-dc1e14ccc405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06435699-3e75-45c6-b7a8-4536a6e60120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06435699-3e75-45c6-b7a8-4536a6e60120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31270f3-78e2-491c-a61c-f7ffab50c38e', 'volume_name': 'volume-c31270f3-78e2-491c-a61c-f7ffab50c38e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce92c3c0-4a15-46f5-b805-8b2af67080ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce92c3c0-4a15-46f5-b805-8b2af67080ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6e7fc-eb55-4492-8975-52faa969e730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume c31270f3-78e2-491c-a61c-f7ffab50c38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31270f3-78e2-491c-a61c-f7ffab50c38e', 'volume_size': 1} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea969c1-9a14-4d31-9104-f62f88bd88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1614871835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89921e99-ca1e-4a46-a3ab-4982a7d287f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9bce596ffc540dca439e125c897c739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b87c1a39-680a-4882-b8ad-e322ea67a589,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:31Z,use_quota=True,user_id='6828be985ef44cd6b6255d70f8407019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f412382-f62f-447a-9056-f1e511304150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f412382-f62f-447a-9056-f1e511304150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1266f4-86af-49fc-90e4-600e9e553de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1266f4-86af-49fc-90e4-600e9e553de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89921e99-ca1e-4a46-a3ab-4982a7d287f7', 'volume_name': 'volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7', 'volume_size': 1, 'snapshot_id': 'b87c1a39-680a-4882-b8ad-e322ea67a589'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1579da6-6ea5-4878-bb08-cdb6be7cba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1579da6-6ea5-4878-bb08-cdb6be7cba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150b3c04-659e-49a5-9633-57561f673745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Volume 89921e99-ca1e-4a46-a3ab-4982a7d287f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7', 'volume_size': 1, 'snapshot_id': 'b87c1a39-680a-4882-b8ad-e322ea67a589'} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" returned: 0 in 0.592s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 1073741824" returned: 0 in 0.620s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl" returned: 0 in 0.493s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b Sep 25 13:01:31 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 Sep 25 13:01:31 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl Sep 25 13:01:31 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" returned: 0 in 0.319s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-e77aa1b1-da2c-4e45-9d3e-7290beadf14b" released by "delete_volume" :: held 1.015s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Created reservations ['22ba444c-c302-47cb-81ec-578f157cc8e6', '2d69f4ca-5db2-49e3-b732-d8e1cb587ca7', '32b7e277-ce77-4ac4-80b2-6871896ec847', '6927dc6b-1598-4d9c-9a4a-1cb177c385a4'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:31 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.668s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14694783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83137d29-8a35-45d6-83f6-2e180378c1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:29Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume 83137d29-8a35-45d6-83f6-2e180378c1fc {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:31 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136c38e5-d7fe-419f-8033-9a022ac47aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ecf712-c087-4bea-a34d-3bb535d50285', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c5bf4d-006f-48dd-8f38-84f4241886a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:31 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc 1073741824 Sep 25 13:01:31 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:31 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-e6ecf712-c087-4bea-a34d-3bb535d50285 (e6ecf712-c087-4bea-a34d-3bb535d50285): created successfully Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c5bf4d-006f-48dd-8f38-84f4241886a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:31 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (b4fc006a-a25c-4886-932f-0ce9e003cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl" returned: 1 in 0.525s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23387a5e-f861-420f-92aa-654ceb3ce012_9szarhzl' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400a15f-e465-4061-a3be-5fefb8d52ecd]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-54125dae-4c87-4a5d-a835-7052e146b749 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:31 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:31 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:32 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.292s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Deleted volume successfully. Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77365f23-429a-40a7-ab38-fcae65d9f243 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-e77aa1b1-da2c-4e45-9d3e-7290beadf14b-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:32 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:32 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc 1073741824" returned: 0 in 0.584s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:32 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc Sep 25 13:01:32 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD Sep 25 13:01:32 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:32 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] 23387a5e-f861-420f-92aa-654ceb3ce012 was raw, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc" returned: 0 in 0.362s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368512566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8a0b32-b06e-401c-9a54-62a6490328be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:29Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume 4f8a0b32-b06e-401c-9a54-62a6490328be {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:32 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:32 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:32 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be 1073741824 Sep 25 13:01:32 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c848fad-80bc-4e25-8a83-89d87fa4b95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83137d29-8a35-45d6-83f6-2e180378c1fc', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb53ad4-d37c-4579-aef3-6de7c8a5c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-d185883e-392a-4910-ab97-9d79b913ba62-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:32 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-83137d29-8a35-45d6-83f6-2e180378c1fc (83137d29-8a35-45d6-83f6-2e180378c1fc): created successfully Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb53ad4-d37c-4579-aef3-6de7c8a5c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (f969cb24-bc9f-4f12-8cf9-2e39af24b868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-d185883e-392a-4910-ab97-9d79b913ba62-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-66663e67-6a35-49cf-8b4a-0b773e271e49 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "cinder-quobyte-d185883e-392a-4910-ab97-9d79b913ba62" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-d185883e-392a-4910-ab97-9d79b913ba62" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e222000-ceaa-4d1c-9d38-7c82dc70f487]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:33 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 Sep 25 13:01:33 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:33 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be 1073741824" returned: 0 in 0.607s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910" returned: 0 in 0.673s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23387a5e-f861-420f-92aa-654ceb3ce012_dcc8jgi4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:01:33 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:33 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1G Sep 25 13:01:33 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:33 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be Sep 25 13:01:33 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:33 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62" returned: 0 in 0.484s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:33 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62 Sep 25 13:01:33 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:33 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be" returned: 0 in 0.326s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.571s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393367878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2479c148-8382-4fc2-9841-b66942357823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:30Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume 2479c148-8382-4fc2-9841-b66942357823 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:33 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:33 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-d185883e-392a-4910-ab97-9d79b913ba62" returned: 0 in 0.337s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 1073741824 Sep 25 13:01:33 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:33 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a738ea11-daeb-41a9-ba60-e9383b9cf95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8a0b32-b06e-401c-9a54-62a6490328be', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe9a491-556b-4224-b925-ec3caf77d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-quobyte-d185883e-392a-4910-ab97-9d79b913ba62" released by "delete_volume" :: held 0.918s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 1G" returned: 0 in 0.494s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Downloaded image 23387a5e-f861-420f-92aa-654ceb3ce012 ((None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}])) to volume 4a387463-3175-4bd9-88ac-85be16f72910 successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Temporary image 23387a5e-f861-420f-92aa-654ceb3ce012 for user bee696f1dd744b4dac22e269efd4913d is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Marking volume 4a387463-3175-4bd9-88ac-85be16f72910 as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:01:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-4f8a0b32-b06e-401c-9a54-62a6490328be (4f8a0b32-b06e-401c-9a54-62a6490328be): created successfully Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe9a491-556b-4224-b925-ec3caf77d59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (948ce03f-a0bc-4a59-92e8-506b47618073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Copying metadata from image 23387a5e-f861-420f-92aa-654ceb3ce012 to 4a387463-3175-4bd9-88ac-85be16f72910. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:01:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Creating volume glance metadata for volume 4a387463-3175-4bd9-88ac-85be16f72910 backed by image 23387a5e-f861-420f-92aa-654ceb3ce012 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '92cadb9a2990f12df9166ac100738827', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93e11379-cdd1-492c-81da-cd16d044f20e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Created reservations ['f4fa443d-4636-4051-a4bf-21f48bc9f1c8', '015074a7-896c-4b95-a606-71953f77ef33', '492f7802-93ce-4774-bb57-960985bc9b02', 'f75ce634-533c-4d48-879e-884c6f003836'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4d6721-9028-4f78-a935-03b4c7690e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a387463-3175-4bd9-88ac-85be16f72910', 'volume_size': 1, 'image_id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23387a5e-f861-420f-92aa-654ceb3ce012', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92cadb9a2990f12df9166ac100738827', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4f5b65634f64600b2dac338089abe8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '041d3debcaff8a22972e65cc83541091736af4c6793f24fd0fc16c53e87685bbb04508f00176748c73f94569add45517c10d6e0f4ef95a5f6ff5e251c3af7ff5', 'id': '23387a5e-f861-420f-92aa-654ceb3ce012', 'created_at': datetime.datetime(2026, 9, 25, 11, 1, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 1, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23387a5e-f861-420f-92aa-654ceb3ce012/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b9c190-40e5-4724-94cc-f77758a1bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Volume volume-4a387463-3175-4bd9-88ac-85be16f72910 (4a387463-3175-4bd9-88ac-85be16f72910): created successfully Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b9c190-40e5-4724-94cc-f77758a1bef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Flow 'volume_create_manager' (56ea62f2-aa8d-48dd-ae84-68519d2c4dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7a59d06f-0cf7-484f-b504-ff2ffbed6255 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Created volume successfully. Sep 25 13:01:34 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:34 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:34 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 1073741824" returned: 0 in 0.562s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:34 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 Sep 25 13:01:34 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:34 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.302s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Deleted volume successfully. Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abd557ff-0300-4df4-a431-b0263dc758c9 tempest-CreateVolumesFromImageTest-174654178 None] Lock "cinder-d185883e-392a-4910-ab97-9d79b913ba62-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:34 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212576300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31270f3-78e2-491c-a61c-f7ffab50c38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b69e19952948a1a41224426c2b188a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:31Z,use_quota=True,user_id='7208fa4875164264a419b6fe5bf79e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Creating volume c31270f3-78e2-491c-a61c-f7ffab50c38e {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:34 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e 1073741824 Sep 25 13:01:34 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa3f5a9-8607-484a-85c0-d3aee5722348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2479c148-8382-4fc2-9841-b66942357823', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db5c9ad-480f-4f6b-bd95-f4b958fb134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Acquiring lock "cinder-4a387463-3175-4bd9-88ac-85be16f72910-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-2479c148-8382-4fc2-9841-b66942357823 (2479c148-8382-4fc2-9841-b66942357823): created successfully Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db5c9ad-480f-4f6b-bd95-f4b958fb134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (40e860fd-330d-415e-8e00-59ace571c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-58a59cb3-884f-4d1f-ac8e-d9ed3f1577b7 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "cinder-4a387463-3175-4bd9-88ac-85be16f72910-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Acquiring lock "cinder-quobyte-4a387463-3175-4bd9-88ac-85be16f72910" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "cinder-quobyte-4a387463-3175-4bd9-88ac-85be16f72910" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd1cc8-a493-4131-a2f4-6d57e13f6f44]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:35 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 Sep 25 13:01:35 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:35 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e 1073741824" returned: 0 in 0.637s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:35 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e Sep 25 13:01:35 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:35 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:35 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910 Sep 25 13:01:35 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:35 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e" returned: 0 in 0.319s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.495s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589-89921e99-ca1e-4a46-a3ab-4982a7d287f7" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6e7fc-eb55-4492-8975-52faa969e730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31270f3-78e2-491c-a61c-f7ffab50c38e', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a6242f-a5f3-4c2f-9654-b76591658c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589-89921e99-ca1e-4a46-a3ab-4982a7d287f7" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Creating volume 89921e99-ca1e-4a46-a3ab-4982a7d287f7 from snapshot b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:35 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Volume volume-c31270f3-78e2-491c-a61c-f7ffab50c38e (c31270f3-78e2-491c-a61c-f7ffab50c38e): created successfully Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a6242f-a5f3-4c2f-9654-b76591658c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Flow 'volume_create_manager' (5ff4ba88-a010-4f87-847e-2fb14b4b33e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] snapshot: b87c1a39-680a-4882-b8ad-e322ea67a589, volume: 89921e99-ca1e-4a46-a3ab-4982a7d287f7, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:01:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-384604c9-832a-48db-9813-a9f91920f6ec tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created volume successfully. Sep 25 13:01:36 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a387463-3175-4bd9-88ac-85be16f72910" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "cinder-quobyte-4a387463-3175-4bd9-88ac-85be16f72910" released by "delete_volume" :: held 1.004s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbe63e-b945-44a9-b964-2ec060ce82b3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Created reservations ['70e0e24e-fd00-4a40-913e-8c86a95a2b7e', 'cfaa7d95-ebde-4618-aa47-2035ac1e6c78', '1b9b4b35-0a89-4e64-8f10-8e0d5b8c5642', '424c2f2a-e379-453e-bd9e-1ed474bdb76b'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:36 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:36 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:36 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:36 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-c31270f3-78e2-491c-a61c-f7ffab50c38e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-c31270f3-78e2-491c-a61c-f7ffab50c38e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-c31270f3-78e2-491c-a61c-f7ffab50c38e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-c31270f3-78e2-491c-a61c-f7ffab50c38e" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e4b5d-e7aa-4dac-8580-000731d171d2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:36 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.404s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Deleted volume successfully. Sep 25 13:01:36 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.607s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f396c035-e9d3-49a8-b544-cf3ac1def81c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-9fd519c9-4d18-4b95-bdad-fedd9e87aef4 tempest-VolumeAndVolumeTypeFromImageTest-185002057 None] Lock "cinder-4a387463-3175-4bd9-88ac-85be16f72910-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e057a84-82d2-4540-87c6-02a7ec018efb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:36 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e Sep 25 13:01:36 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:36 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:36 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:37 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:37 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e Sep 25 13:01:37 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:37 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.514s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:37 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 Sep 25 13:01:37 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:37 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-c31270f3-78e2-491c-a61c-f7ffab50c38e" returned: 0 in 0.307s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-c31270f3-78e2-491c-a61c-f7ffab50c38e" released by "delete_volume" :: held 0.922s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['455e3b7b-6b10-4d4c-8d93-8029a6abcb7c', '1d8f0e1d-27f6-498a-820c-63fe3eca8103', 'e53ad3a2-3df8-4744-a911-27f8c8f8c99a', '96d6efd2-e7b6-4379-bc99-3442985e8f96'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:37 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:37 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:38 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.422s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:38 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:38 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4e0d10ed-ce22-411f-82cb-c9532cc4e49e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-c31270f3-78e2-491c-a61c-f7ffab50c38e-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-2479c148-8382-4fc2-9841-b66942357823-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-2479c148-8382-4fc2-9841-b66942357823-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-2479c148-8382-4fc2-9841-b66942357823" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-2479c148-8382-4fc2-9841-b66942357823" acquired by "delete_volume" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7102aeb-1214-42b3-b419-d3878aeb8ec1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:39 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 Sep 25 13:01:39 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:40 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823" returned: 0 in 0.974s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:40 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823 Sep 25 13:01:40 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:41 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2479c148-8382-4fc2-9841-b66942357823" returned: 0 in 0.633s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-2479c148-8382-4fc2-9841-b66942357823" released by "delete_volume" :: held 1.725s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['e362560b-5033-4035-aee7-4dd441587383', 'b87a6d83-614e-4f6d-b7f3-8416926ced15', '387fa4fe-6c13-4341-96c0-43b18d4ccebe', '8cb69888-3042-481f-8e20-570fe078cc8c'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:41 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:41 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-4f8a0b32-b06e-401c-9a54-62a6490328be-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-4f8a0b32-b06e-401c-9a54-62a6490328be-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-4f8a0b32-b06e-401c-9a54-62a6490328be" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-4f8a0b32-b06e-401c-9a54-62a6490328be" acquired by "delete_volume" :: waited 0.089s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Flow 'volume_create_manager' (7672233e-30f7-43f4-ad3a-e5062c99c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723ea6ac-b772-428f-8897-b4aa7662cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7eb4ae-5250-409b-bc0a-734f244d9330]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723ea6ac-b772-428f-8897-b4aa7662cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3faa3d4-3387-49b9-901f-d64ecf524d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0d95b8c69442e9be0c5286ce17d42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:42Z,use_quota=True,user_id='dd049278d4274812ba95be994b48bb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035c5697-a0d4-4bb9-950e-399a5d273608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035c5697-a0d4-4bb9-950e-399a5d273608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:42 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0099c4-7eb4-4061-b1f6-5abc533d2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0099c4-7eb4-4061-b1f6-5abc533d2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3faa3d4-3387-49b9-901f-d64ecf524d7c', 'volume_name': 'volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d296be62-2fdb-4dd5-bd2d-dbe226cfe561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d296be62-2fdb-4dd5-bd2d-dbe226cfe561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6315e7f2-2e8b-40f5-a2ef-afece853eca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Volume a3faa3d4-3387-49b9-901f-d64ecf524d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c', 'volume_size': 1} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.901s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:42 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be Sep 25 13:01:42 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09e555b2-ab41-433a-96da-05861b63b2e9 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-2479c148-8382-4fc2-9841-b66942357823-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:43 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be" returned: 0 in 0.935s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:43 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be Sep 25 13:01:43 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:43 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4f8a0b32-b06e-401c-9a54-62a6490328be" returned: 0 in 0.607s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-4f8a0b32-b06e-401c-9a54-62a6490328be" released by "delete_volume" :: held 1.786s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['b02ff5fe-9a98-4cc8-980f-f083ccff0a1f', '0df16d03-6691-4895-82e4-b429db5fb226', 'fc1898e9-7f07-4118-be87-65b8c4e5aa7e', 'c88ef84e-8908-402f-b32e-a2bbcdcb77bd'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:44 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:44 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-83137d29-8a35-45d6-83f6-2e180378c1fc-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-83137d29-8a35-45d6-83f6-2e180378c1fc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-83137d29-8a35-45d6-83f6-2e180378c1fc" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-83137d29-8a35-45d6-83f6-2e180378c1fc" acquired by "delete_volume" :: waited 0.044s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[960021c2-b44f-46d6-8795-576fa97febda]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:45 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc Sep 25 13:01:45 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:45 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.683s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:45 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:45 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f89d083-a310-4ecc-9fc7-35bf78924fbe tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-4f8a0b32-b06e-401c-9a54-62a6490328be-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:45 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc" returned: 0 in 1.002s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:45 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc Sep 25 13:01:45 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:46 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-83137d29-8a35-45d6-83f6-2e180378c1fc" returned: 0 in 0.617s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-83137d29-8a35-45d6-83f6-2e180378c1fc" released by "delete_volume" :: held 1.757s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['128cc742-f004-4df3-a275-81f138aae1b6', '893267f2-7ea6-4ca6-a6e6-d5de6d692dc0', '61f0abd1-d106-4907-8f5c-c3a34044c4c5', '007ce1e8-ec47-48f9-bd0b-7a8f670b32a2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:46 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:46 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-e6ecf712-c087-4bea-a34d-3bb535d50285-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-e6ecf712-c087-4bea-a34d-3bb535d50285-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-e6ecf712-c087-4bea-a34d-3bb535d50285" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:47 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7" returned: 0 in 9.982s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:01:47 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Converted 1024.00 MB image at 102.58 MB/s Sep 25 13:01:47 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 is being set with open permissions: ugo+rw Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:47 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:47 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:47 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-e6ecf712-c087-4bea-a34d-3bb535d50285" acquired by "delete_volume" :: waited 0.069s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:47 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:47 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8629be0d-ca40-439b-bbf8-aa270a3a5193]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-4f5b6e91-8209-439d-87c7-90fbee57718b tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-83137d29-8a35-45d6-83f6-2e180378c1fc-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:47 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 Sep 25 13:01:47 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:47 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:47 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.352s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" released by "_copy_volume_from_snapshot" :: held 11.639s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589-89921e99-ca1e-4a46-a3ab-4982a7d287f7" released by "_create_volume_from_snapshot" :: held 11.757s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.798s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.203s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3faa3d4-3387-49b9-901f-d64ecf524d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0d95b8c69442e9be0c5286ce17d42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:42Z,use_quota=True,user_id='dd049278d4274812ba95be994b48bb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Creating volume a3faa3d4-3387-49b9-901f-d64ecf524d7c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:47 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:47 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c 1073741824 Sep 25 13:01:47 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150b3c04-659e-49a5-9633-57561f673745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7', 'volume_size': 1, 'snapshot_id': 'b87c1a39-680a-4882-b8ad-e322ea67a589'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1235c8db-32be-4463-89ec-bea947e44e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:47 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Volume volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 (89921e99-ca1e-4a46-a3ab-4982a7d287f7): created successfully Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1235c8db-32be-4463-89ec-bea947e44e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Flow 'volume_create_manager' (b1d2e8ad-b772-4895-860b-a8a0f960a125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:47 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d9877cde-10ee-4ad6-bee7-3cb497d94e60 tempest-VolumeDependencyTests-1674013013 None] Created volume successfully. Sep 25 13:01:47 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285 Sep 25 13:01:47 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:48 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6ecf712-c087-4bea-a34d-3bb535d50285" returned: 0 in 0.289s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-e6ecf712-c087-4bea-a34d-3bb535d50285" released by "delete_volume" :: held 0.837s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['7dfc982f-e5e1-41af-bb8e-b3195c60ae32', 'f4654d26-eb00-4524-9aa8-4925c8d2fb64', 'a4dc6bbb-951c-4311-be05-e106f6f1c4e9', '7fd51cc0-a527-4bcc-aead-8b33c1f0ac1f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:48 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:48 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:48 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c 1073741824" returned: 0 in 0.625s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-d85f1567-92c8-4005-a724-be0bc9993e44-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-d85f1567-92c8-4005-a724-be0bc9993e44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-d85f1567-92c8-4005-a724-be0bc9993e44" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c Sep 25 13:01:48 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-d85f1567-92c8-4005-a724-be0bc9993e44" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleting offline snapshot d85f1567-92c8-4005-a724-be0bc9993e44 of volume 8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] snapshot_file for this snap is: volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[609246c7-1763-4874-ac96-a1b6f13a8c9c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:48 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.344s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-b87c1a39-680a-4882-b8ad-e322ea67a589-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-b87c1a39-680a-4882-b8ad-e322ea67a589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ce6c9b1d-e906-4478-b74f-76014bf78ad5 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-e6ecf712-c087-4bea-a34d-3bb535d50285-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Deleting offline snapshot b87c1a39-680a-4882-b8ad-e322ea67a589 of volume f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:01:48 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 Sep 25 13:01:48 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] snapshot_file for this snap is: volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:01:48 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c" returned: 0 in 0.398s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0df89b-e58d-40a5-9972-162186708636]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6315e7f2-2e8b-40f5-a2ef-afece853eca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d9a82-b56d-439b-a6c5-4ca228db3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:48 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Volume volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c (a3faa3d4-3387-49b9-901f-d64ecf524d7c): created successfully Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d9a82-b56d-439b-a6c5-4ca228db3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Flow 'volume_create_manager' (7672233e-30f7-43f4-ad3a-e5062c99c957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2738607e-84bb-409d-a52e-ff7dadbf568d tempest-CinderUnicodeTest-1311947929 None] Created volume successfully. Sep 25 13:01:48 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:48 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:49 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (a40ce598-cf31-43d4-9a3b-7b576a8c63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48205b32-776f-4bbc-a535-143a05633290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d1066e7-8a72-4ab7-8186-05997797f90e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48205b32-776f-4bbc-a535-143a05633290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213594226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54394cf-3476-4c9a-8ca1-624e840afd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:49Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57a100b-3178-4842-a323-8b666a009bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57a100b-3178-4842-a323-8b666a009bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea7dfcf-b002-43b5-9f49-c995716b17be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea7dfcf-b002-43b5-9f49-c995716b17be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54394cf-3476-4c9a-8ca1-624e840afd6a', 'volume_name': 'volume-b54394cf-3476-4c9a-8ca1-624e840afd6a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ed36b-a7b9-49d1-a0f4-965ba33b47d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ed36b-a7b9-49d1-a0f4-965ba33b47d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeda815a-e147-474a-bbd6-7123e73deb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume b54394cf-3476-4c9a-8ca1-624e840afd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54394cf-3476-4c9a-8ca1-624e840afd6a', 'volume_size': 1} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-213594226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54394cf-3476-4c9a-8ca1-624e840afd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:49Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume b54394cf-3476-4c9a-8ca1-624e840afd6a {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:49 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68979c2-030e-4c42-847b-d83ed11b53c0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:49 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a 1073741824 Sep 25 13:01:49 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:49 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.467s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f396c035-e9d3-49a8-b544-cf3ac1def81c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2249adb7-483a-436b-9335-129223f57400]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:49 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e Sep 25 13:01:49 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:49 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:49 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:49 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:49 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 Sep 25 13:01:49 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:49 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a 1073741824" returned: 0 in 0.583s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:49 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a Sep 25 13:01:49 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:50 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.699s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:50 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:50 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:50 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a" returned: 0 in 0.397s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:50 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeda815a-e147-474a-bbd6-7123e73deb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54394cf-3476-4c9a-8ca1-624e840afd6a', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010ff5e7-0f00-460c-9cc4-bc18b49480e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44" returned: 0 in 0.558s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-b54394cf-3476-4c9a-8ca1-624e840afd6a (b54394cf-3476-4c9a-8ca1-624e840afd6a): created successfully Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010ff5e7-0f00-460c-9cc4-bc18b49480e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44 Sep 25 13:01:50 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (a40ce598-cf31-43d4-9a3b-7b576a8c63b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-17c87ba5-ee81-45c9-b763-f83ccced826e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Flow 'volume_create_manager' (b443812b-a6f8-4094-8dd2-edff8506a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f395968e-a619-4a97-ba0e-5be2b05a89e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f395968e-a619-4a97-ba0e-5be2b05a89e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-636182787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25be6f3-61b6-43c5-9d07-c4718a4c8af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0d95b8c69442e9be0c5286ce17d42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:50Z,use_quota=True,user_id='dd049278d4274812ba95be994b48bb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28143cef-9092-4290-bf94-a3fbd95e2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28143cef-9092-4290-bf94-a3fbd95e2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825a39fd-91b4-442c-8fa1-c926a9122074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825a39fd-91b4-442c-8fa1-c926a9122074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25be6f3-61b6-43c5-9d07-c4718a4c8af9', 'volume_name': 'volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efb195a-410b-4325-91db-44978553f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efb195a-410b-4325-91db-44978553f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245b122-a193-4479-a20b-d37f7860ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Volume a25be6f3-61b6-43c5-9d07-c4718a4c8af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9', 'volume_size': 1} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-636182787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25be6f3-61b6-43c5-9d07-c4718a4c8af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0d95b8c69442e9be0c5286ce17d42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:50Z,use_quota=True,user_id='dd049278d4274812ba95be994b48bb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Creating volume a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:50 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:50 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.508s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:50 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 1073741824 Sep 25 13:01:50 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:50 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589 Sep 25 13:01:50 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:50 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e.d85f1567-92c8-4005-a724-be0bc9993e44" returned: 0 in 0.332s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-d85f1567-92c8-4005-a724-be0bc9993e44" released by "_delete_snapshot" :: held 2.204s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" released by "delete_snapshot" :: held 2.242s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['c29354aa-a688-47e4-927f-4da4b3a09a96', '77106517-05eb-4099-941b-dbfc7c80a0e9', '40a9bb7c-9e7c-4dd1-a135-28706565e35b', '63137a92-e7f9-4499-96ac-91a0c6c906cf'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Delete snapshot completed successfully. Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-12a76ea6-a8a1-429a-a82c-c0bb8685868e tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-d85f1567-92c8-4005-a724-be0bc9993e44-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:50 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c.b87c1a39-680a-4882-b8ad-e322ea67a589" returned: 0 in 0.328s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-b87c1a39-680a-4882-b8ad-e322ea67a589" released by "_delete_snapshot" :: held 2.142s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" released by "delete_snapshot" :: held 2.170s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:50 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Created reservations ['c5ff192c-0923-43ec-9faf-a18b015e545f', '11ca4e08-cb0b-48e7-8e4e-43f20c406d25', '4d4ab827-0506-4a11-9db7-5f7601f37862', 'f7bead87-c1c9-429f-8183-b7a2aaddad8f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Delete snapshot completed successfully. Sep 25 13:01:51 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1f6f1543-1471-4d24-8a54-d39a1751a1a3 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-b87c1a39-680a-4882-b8ad-e322ea67a589-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 1073741824" returned: 0 in 0.529s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:51 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 Sep 25 13:01:51 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:51 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" returned: 0 in 0.297s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245b122-a193-4479-a20b-d37f7860ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b155bb3a-d900-4202-b888-ace23a61077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Volume volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 (a25be6f3-61b6-43c5-9d07-c4718a4c8af9): created successfully Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b155bb3a-d900-4202-b888-ace23a61077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Flow 'volume_create_manager' (b443812b-a6f8-4094-8dd2-edff8506a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93b8147e-384b-41c0-a7e9-fd979da147df tempest-CinderUnicodeTest-1311947929 None] Created volume successfully. Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-8d1066e7-8a72-4ab7-8186-05997797f90e-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-8d1066e7-8a72-4ab7-8186-05997797f90e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c2b24-5ae4-430b-abce-7b4b2b49f8c2]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (94333fd1-7d28-42b5-94f7-78e3eaf43965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f94222-83e9-46f1-ac7d-375e57fc7f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f94222-83e9-46f1-ac7d-375e57fc7f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063273552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff561ed2-fb4d-4574-9858-e29994384df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:52Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01434db1-4062-43d6-832c-9ee3aa4f1327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01434db1-4062-43d6-832c-9ee3aa4f1327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f20bb3e-e90d-4c43-aa27-15070a38b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f20bb3e-e90d-4c43-aa27-15070a38b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff561ed2-fb4d-4574-9858-e29994384df9', 'volume_name': 'volume-ff561ed2-fb4d-4574-9858-e29994384df9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e Sep 25 13:01:51 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319d3bea-4796-477e-9e48-58ec285c8ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319d3bea-4796-477e-9e48-58ec285c8ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc0d411-ffcc-4026-ba09-b073dc576212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume ff561ed2-fb4d-4574-9858-e29994384df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff561ed2-fb4d-4574-9858-e29994384df9', 'volume_size': 1} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063273552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff561ed2-fb4d-4574-9858-e29994384df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:52Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume ff561ed2-fb4d-4574-9858-e29994384df9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:51 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-f396c035-e9d3-49a8-b544-cf3ac1def81c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:52 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 1073741824 Sep 25 13:01:52 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-f396c035-e9d3-49a8-b544-cf3ac1def81c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b80743-92ef-4658-b9b8-8a57f7e72665]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (b0910d4b-c313-4bec-8d13-f12b81619a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db755bc1-c09c-496e-ab49-2f7d22b7c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db755bc1-c09c-496e-ab49-2f7d22b7c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737587167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e095c3-39f5-47cf-92da-7c13b33ce6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:52Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cce3f0-2d37-4a4c-ab3b-fcb188a7cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cce3f0-2d37-4a4c-ab3b-fcb188a7cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0981f4f-490d-490b-aa7a-ae2f5fbd9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0981f4f-490d-490b-aa7a-ae2f5fbd9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e095c3-39f5-47cf-92da-7c13b33ce6a5', 'volume_name': 'volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f9d5bb-ff41-4561-8a3d-1b2a824aa010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f9d5bb-ff41-4561-8a3d-1b2a824aa010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7585b04d-d8c2-4364-92f1-c781485b65d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:52 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume 48e095c3-39f5-47cf-92da-7c13b33ce6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5', 'volume_size': 1} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:52 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e" returned: 0 in 0.764s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:52 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:52 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:52 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e Sep 25 13:01:52 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:52 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-8d1066e7-8a72-4ab7-8186-05997797f90e" returned: 0 in 0.422s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:52 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-quobyte-8d1066e7-8a72-4ab7-8186-05997797f90e" released by "delete_volume" :: held 1.298s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:53 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:53 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 1073741824" returned: 0 in 1.072s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.883s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:53 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c Sep 25 13:01:53 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (a6af74aa-68e6-49d9-8bf3-026e5872ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f460888e-f9df-478d-9f63-439a861c9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f460888e-f9df-478d-9f63-439a861c9179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373493616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3844095c-ff49-4ba4-83ff-bf1ee38106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:53Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416c4863-1ca8-4fa7-8a7a-fb1704cb706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416c4863-1ca8-4fa7-8a7a-fb1704cb706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 Sep 25 13:01:53 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100e1f2c-aff1-4afe-9d5b-4d35358bcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100e1f2c-aff1-4afe-9d5b-4d35358bcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3844095c-ff49-4ba4-83ff-bf1ee38106e9', 'volume_name': 'volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f214b8a-04fb-4efc-8832-dabc2e473d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f214b8a-04fb-4efc-8832-dabc2e473d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9a05a-f6be-4d67-b453-e61cc29c1ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume 3844095c-ff49-4ba4-83ff-bf1ee38106e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9', 'volume_size': 1} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Created reservations ['3d619de8-6a05-4f93-8ba0-cd45dc68e581', 'bef13c7f-a576-4b6c-92a1-fcedb3b8f91e', '98375cf5-7725-407a-8599-f4e2466624b4', '5486d0a1-c70d-4515-99c9-0fc7b6e87ef3'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (121039ad-f3f6-4d5c-8997-8ae72ea5ba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98916453-b61d-40d2-8d5c-8a10f74e4283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98916453-b61d-40d2-8d5c-8a10f74e4283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-244426206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231690e0-e6c0-453d-bdd4-7b507802a796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:53Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459498e6-662e-4427-9ff8-d65a51da4cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459498e6-662e-4427-9ff8-d65a51da4cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c4aab-8231-4c5d-8ed6-dbb884063c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c4aab-8231-4c5d-8ed6-dbb884063c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231690e0-e6c0-453d-bdd4-7b507802a796', 'volume_name': 'volume-231690e0-e6c0-453d-bdd4-7b507802a796', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44240888-83f4-43dc-b07a-4095de52f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44240888-83f4-43dc-b07a-4095de52f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d66f6-253c-4e52-84ed-0db08457dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume 231690e0-e6c0-453d-bdd4-7b507802a796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231690e0-e6c0-453d-bdd4-7b507802a796', 'volume_size': 1} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f396c035-e9d3-49a8-b544-cf3ac1def81c" returned: 0 in 0.524s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-f396c035-e9d3-49a8-b544-cf3ac1def81c" released by "delete_volume" :: held 1.530s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:53 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9" returned: 0 in 0.410s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737587167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e095c3-39f5-47cf-92da-7c13b33ce6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:52Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume 48e095c3-39f5-47cf-92da-7c13b33ce6a5 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:53 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc0d411-ffcc-4026-ba09-b073dc576212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff561ed2-fb4d-4574-9858-e29994384df9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 1073741824 Sep 25 13:01:53 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8efa8c5-1979-4248-8e4a-ac0ccf959736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:53 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-ff561ed2-fb4d-4574-9858-e29994384df9 (ff561ed2-fb4d-4574-9858-e29994384df9): created successfully Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8efa8c5-1979-4248-8e4a-ac0ccf959736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (94333fd1-7d28-42b5-94f7-78e3eaf43965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-39fda20e-4c1b-486c-9b85-bd74e55a9b60 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Created reservations ['47930650-c1b8-4d96-a84d-aa19cea10d7e', '0ce074a9-5d3a-43ac-8c81-2ae576035c5f', '35867b79-763c-45a5-ac14-756f9e750ef8', 'cf32c95b-aace-44a1-9e9d-512ccf1d2549'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:53 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:53 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:01:54 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:54 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (793841cd-d780-4144-9c49-7e6732390ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d5e4a1-ec27-4d94-ab33-eb1eb415936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d5e4a1-ec27-4d94-ab33-eb1eb415936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010056838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd5462-afbb-4401-90ea-566259242ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:54Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232b1adf-bf84-4900-b7e9-59e27296d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232b1adf-bf84-4900-b7e9-59e27296d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff77d375-0ba4-4102-95b4-bba7fb0a8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff77d375-0ba4-4102-95b4-bba7fb0a8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fd5462-afbb-4401-90ea-566259242ed3', 'volume_name': 'volume-36fd5462-afbb-4401-90ea-566259242ed3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624dc6d1-c918-44e9-8fd2-b145d265432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624dc6d1-c918-44e9-8fd2-b145d265432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2490e01e-0a36-4c7c-a339-274f28c9d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume 36fd5462-afbb-4401-90ea-566259242ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fd5462-afbb-4401-90ea-566259242ed3', 'volume_size': 1} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:54 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.365s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Deleted volume successfully. Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-f275ce1c-67cd-41ec-bcd2-bc11b1d967d2 tempest-CreateVolumesFromSnapshotTest-1124406149 None] Lock "cinder-8d1066e7-8a72-4ab7-8186-05997797f90e-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-89921e99-ca1e-4a46-a3ab-4982a7d287f7-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-89921e99-ca1e-4a46-a3ab-4982a7d287f7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:54 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.501s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Deleted volume successfully. Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:54 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 1073741824" returned: 0 in 0.813s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[095dae82-5ed1-4132-9fff-692466c2bfe7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-b0156e71-1246-4db1-9f80-e76434dd5b5c tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-f396c035-e9d3-49a8-b544-cf3ac1def81c-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:54 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 Sep 25 13:01:54 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:54 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 Sep 25 13:01:54 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:54 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5" returned: 0 in 0.299s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373493616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3844095c-ff49-4ba4-83ff-bf1ee38106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:53Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume 3844095c-ff49-4ba4-83ff-bf1ee38106e9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:54 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7585b04d-d8c2-4364-92f1-c781485b65d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 1073741824 Sep 25 13:01:54 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd453e3-2b7f-439f-8989-c3767fb66765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:54 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 (48e095c3-39f5-47cf-92da-7c13b33ce6a5): created successfully Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd453e3-2b7f-439f-8989-c3767fb66765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (b0910d4b-c313-4bec-8d13-f12b81619a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d3b3260b-7e82-4ce4-8bb8-c341192a7f78 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:01:55 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7" returned: 0 in 0.512s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:55 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7 Sep 25 13:01:55 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:55 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-89921e99-ca1e-4a46-a3ab-4982a7d287f7" returned: 0 in 0.315s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-quobyte-89921e99-ca1e-4a46-a3ab-4982a7d287f7" released by "delete_volume" :: held 0.894s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Created reservations ['53aa43cf-b4b0-44bd-b188-e97479998974', '902652f9-ab95-4f20-a68f-03b6c2d6fdea', '431519d3-eff5-4561-9985-a7e443b03cde', '5a552619-1093-4a8e-8cc5-9655f2890fdb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:55 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 1073741824" returned: 0 in 0.657s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:55 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:01:55 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:55 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 Sep 25 13:01:55 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:55 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.401s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Deleted volume successfully. Sep 25 13:01:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-72ef5162-a1ae-481a-aa73-5a1bd3c02ab4 tempest-VolumeDependencyTests-1674013013 None] Lock "cinder-89921e99-ca1e-4a46-a3ab-4982a7d287f7-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:01:55 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9" returned: 0 in 0.402s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.473s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c9a05a-f6be-4d67-b453-e61cc29c1ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc024829-443a-4628-942e-e13b500498f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Creating offline snapshot 2fc6a1c3-4b27-42fa-85da-7129257d1a14 of volume a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:01:56 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 (3844095c-ff49-4ba4-83ff-bf1ee38106e9): created successfully Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc024829-443a-4628-942e-e13b500498f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (a6af74aa-68e6-49d9-8bf3-026e5872ff55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6db2f6-84d8-4b39-a7f2-b1df26a8caaa]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3922b06b-e674-441b-8f17-fef482c70fe3 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:01:56 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 Sep 25 13:01:56 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:56 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" returned: 0 in 0.580s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:56 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 1G Sep 25 13:01:56 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:57 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 1G" returned: 0 in 0.604s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:57 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 Sep 25 13:01:57 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:57 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14" returned: 0 in 0.419s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:57 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 is being set with open permissions: ugo+rw Sep 25 13:01:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:57 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 Sep 25 13:01:57 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:58 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14" returned: 0 in 0.317s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:58 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info Sep 25 13:01:58 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:58 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info" returned: 0 in 0.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:58 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info is being set with open permissions: ugo+rw Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:58 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info Sep 25 13:01:58 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:58 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.info" returned: 0 in 0.338s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.241s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-244426206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231690e0-e6c0-453d-bdd4-7b507802a796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:53Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume 231690e0-e6c0-453d-bdd4-7b507802a796 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:58 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:58 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 1073741824 Sep 25 13:01:58 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8b760288-ce22-4d99-afa4-6d07c9f86dcc tempest-CinderUnicodeTest-1311947929 None] Create snapshot completed successfully Sep 25 13:01:59 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 1073741824" returned: 0 in 0.570s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:59 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 Sep 25 13:01:59 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:59 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-2fc6a1c3-4b27-42fa-85da-7129257d1a14-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796" returned: 0 in 0.406s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.777s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010056838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fd5462-afbb-4401-90ea-566259242ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95a46b8baf42a2a6afc2a3939b81bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:01:54Z,use_quota=True,user_id='623e3be567a1425996d1cfc0bc14f97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Creating volume 36fd5462-afbb-4401-90ea-566259242ed3 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:01:59 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-2fc6a1c3-4b27-42fa-85da-7129257d1a14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:01:59 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 1073741824 Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96d66f6-253c-4e52-84ed-0db08457dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231690e0-e6c0-453d-bdd4-7b507802a796', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:01:59 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2386322f-ba0b-4d2b-ade6-7d20b811a7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-quobyte-2fc6a1c3-4b27-42fa-85da-7129257d1a14" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:00 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-231690e0-e6c0-453d-bdd4-7b507802a796 (231690e0-e6c0-453d-bdd4-7b507802a796): created successfully Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2386322f-ba0b-4d2b-ade6-7d20b811a7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (121039ad-f3f6-4d5c-8997-8ae72ea5ba34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-2fc6a1c3-4b27-42fa-85da-7129257d1a14" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Deleting offline snapshot 2fc6a1c3-4b27-42fa-85da-7129257d1a14 of volume a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] snapshot_file for this snap is: volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:00 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-778db358-949f-476d-9cf5-1ce6c932ec1b tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[49abd2fc-f04a-402b-8e43-4d7efa70798b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:00 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 Sep 25 13:02:00 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:00 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 1073741824" returned: 0 in 0.692s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:00 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 Sep 25 13:02:00 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:00 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14" returned: 0 in 0.617s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3443431-ef78-4747-941b-9fe172ee76fd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:00 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 Sep 25 13:02:00 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:01 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3" returned: 0 in 0.355s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2490e01e-0a36-4c7c-a339-274f28c9d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fd5462-afbb-4401-90ea-566259242ed3', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46ee8ab-ac0b-42ab-8e47-387c39c77f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:01 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Volume volume-36fd5462-afbb-4401-90ea-566259242ed3 (36fd5462-afbb-4401-90ea-566259242ed3): created successfully Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46ee8ab-ac0b-42ab-8e47-387c39c77f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Flow 'volume_create_manager' (793841cd-d780-4144-9c49-7e6732390ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5b817894-9fde-42ae-b0b0-66f189dc122e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created volume successfully. Sep 25 13:02:01 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" returned: 0 in 0.522s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:01 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 Sep 25 13:02:01 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:01 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14" returned: 0 in 0.552s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-36fd5462-afbb-4401-90ea-566259242ed3-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:01 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14 Sep 25 13:02:01 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-36fd5462-afbb-4401-90ea-566259242ed3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-36fd5462-afbb-4401-90ea-566259242ed3" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-36fd5462-afbb-4401-90ea-566259242ed3" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc98093a-f9f3-4531-9778-50698260f3ca]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:02 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:02 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 Sep 25 13:02:02 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9.2fc6a1c3-4b27-42fa-85da-7129257d1a14" returned: 0 in 0.359s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-2fc6a1c3-4b27-42fa-85da-7129257d1a14" released by "_delete_snapshot" :: held 2.267s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" released by "delete_snapshot" :: held 2.339s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Created reservations ['bd82cd81-9188-4b3d-8fce-2ea3f6915521', '548e2391-a35b-4650-9f22-d7b0f8fb767e', '3fd76cac-bdbc-41ea-be96-d1dd6f97fec4', '6f62c838-24a5-46cc-b1ed-7acfeaf1679a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Delete snapshot completed successfully. Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-40546684-5e99-49d3-947d-76cd35975cba tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-2fc6a1c3-4b27-42fa-85da-7129257d1a14-delete_snapshot" released by "delete_snapshot" :: held 2.695s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:02 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3" returned: 0 in 0.594s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:02 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3 Sep 25 13:02:02 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:02 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-36fd5462-afbb-4401-90ea-566259242ed3" returned: 0 in 0.319s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-36fd5462-afbb-4401-90ea-566259242ed3" released by "delete_volume" :: held 0.981s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['51aa593b-b3f7-403b-8d32-0c0fc18466be', '0eee7ce4-2e0b-4214-9cf0-ba19ad285b77', 'b1fb433a-eece-4d2e-9cb9-a56fd1e18148', '67f45da3-2d8a-4d8f-9693-0361a00087c9'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-a25be6f3-61b6-43c5-9d07-c4718a4c8af9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-a25be6f3-61b6-43c5-9d07-c4718a4c8af9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:03 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:03 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" acquired by "delete_volume" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef53f1a-3e41-4ccd-9fbd-b1fb13537c96]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:03 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 Sep 25 13:02:03 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:03 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.389s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-77a3bcee-62da-4853-a265-198dd969a590 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-36fd5462-afbb-4401-90ea-566259242ed3-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:04 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" returned: 0 in 0.546s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:04 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9 Sep 25 13:02:04 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-231690e0-e6c0-453d-bdd4-7b507802a796-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-231690e0-e6c0-453d-bdd4-7b507802a796-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-231690e0-e6c0-453d-bdd4-7b507802a796" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-231690e0-e6c0-453d-bdd4-7b507802a796" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:04 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" returned: 0 in 0.404s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b8b45-6eb0-4caa-8720-bb877cee3c49]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a25be6f3-61b6-43c5-9d07-c4718a4c8af9" released by "delete_volume" :: held 1.065s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Created reservations ['ee18e780-4ded-4e6c-9458-257d80e4673e', '38968d6c-adf3-43cb-8d7c-8f614aec0161', '43ce1221-80b8-4122-9b9a-17333b699d55', '1e2c33cf-f737-4d5f-b7b7-bfae85a867ad'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:04 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 Sep 25 13:02:04 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:04 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:04 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:04 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:04 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796 Sep 25 13:02:04 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:05 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.357s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Deleted volume successfully. Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0b481dde-9027-40e8-9c74-4a60731a3b01 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-a25be6f3-61b6-43c5-9d07-c4718a4c8af9-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:05 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-231690e0-e6c0-453d-bdd4-7b507802a796" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-231690e0-e6c0-453d-bdd4-7b507802a796" released by "delete_volume" :: held 0.952s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['aa182342-dabd-4828-a17c-85241fcab2a2', 'd8ee6b01-5052-41e0-b0a3-0ee863698e46', '7b8f3a71-1fe3-4cda-8f9d-5ed9d54560f5', '1df8c841-d161-4050-bd66-8856c1398d40'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-a3faa3d4-3387-49b9-901f-d64ecf524d7c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:05 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:05 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-a3faa3d4-3387-49b9-901f-d64ecf524d7c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "cinder-quobyte-a3faa3d4-3387-49b9-901f-d64ecf524d7c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a3faa3d4-3387-49b9-901f-d64ecf524d7c" acquired by "delete_volume" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[92867a79-ad70-4048-83c0-548ab22ea059]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:05 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:05 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:05 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:05 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c Sep 25 13:02:05 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0212f484-2e35-41b5-a7d3-bd4c155c76b9 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-231690e0-e6c0-453d-bdd4-7b507802a796-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:06 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c" returned: 0 in 0.568s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:06 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c Sep 25 13:02:06 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (8867b7dd-9d84-4b18-9d4f-bb02f2b79a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54bc2a8-45d0-45e9-b6fd-bd882487d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54bc2a8-45d0-45e9-b6fd-bd882487d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170544943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534470d8-5adf-4ed0-9303-fefc230a92b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:06Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054bab5d-e101-4904-9f7a-c25b4bb4f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054bab5d-e101-4904-9f7a-c25b4bb4f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb18b7-3ec6-4e32-8457-f7bf88137331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb18b7-3ec6-4e32-8457-f7bf88137331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534470d8-5adf-4ed0-9303-fefc230a92b5', 'volume_name': 'volume-534470d8-5adf-4ed0-9303-fefc230a92b5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18e902a-0b21-4adb-b674-3f30ef0bbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18e902a-0b21-4adb-b674-3f30ef0bbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aa52e7-a6ad-4b37-bda0-720479cd04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Volume 534470d8-5adf-4ed0-9303-fefc230a92b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534470d8-5adf-4ed0-9303-fefc230a92b5', 'volume_size': 1} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170544943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534470d8-5adf-4ed0-9303-fefc230a92b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:06Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Creating volume 534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:06 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:06 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 1073741824 Sep 25 13:02:06 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-3844095c-ff49-4ba4-83ff-bf1ee38106e9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-3844095c-ff49-4ba4-83ff-bf1ee38106e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-3844095c-ff49-4ba4-83ff-bf1ee38106e9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-3844095c-ff49-4ba4-83ff-bf1ee38106e9" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:06 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a3faa3d4-3387-49b9-901f-d64ecf524d7c" returned: 0 in 0.438s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeea57f-0653-4747-8fec-49ab4fc5088a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-quobyte-a3faa3d4-3387-49b9-901f-d64ecf524d7c" released by "delete_volume" :: held 1.097s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:06 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Created reservations ['0d07a0c2-6aea-4480-be80-6288edea6d59', 'eb7258a0-c0e8-4a3d-83fb-7eeae6c73f62', '16f0c33e-9db8-4f98-a3a7-2ea188797573', '23a223a3-fc45-42db-9c7a-41e55082de42'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:07 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 Sep 25 13:02:07 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:07 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:07 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:07 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 1073741824" returned: 0 in 0.719s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:07 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 Sep 25 13:02:07 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:07 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.389s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:07 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Deleted volume successfully. Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9" returned: 0 in 0.658s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:07 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9 Sep 25 13:02:07 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-229eb207-a34f-48d1-bca2-40292147ae50 tempest-CinderUnicodeTest-1311947929 None] Lock "cinder-a3faa3d4-3387-49b9-901f-d64ecf524d7c-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:07 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5" returned: 0 in 0.401s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85aa52e7-a6ad-4b37-bda0-720479cd04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534470d8-5adf-4ed0-9303-fefc230a92b5', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6cab8-76cb-4b45-9731-652339402d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:07 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Volume volume-534470d8-5adf-4ed0-9303-fefc230a92b5 (534470d8-5adf-4ed0-9303-fefc230a92b5): created successfully Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6cab8-76cb-4b45-9731-652339402d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (8867b7dd-9d84-4b18-9d4f-bb02f2b79a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:07 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3844095c-ff49-4ba4-83ff-bf1ee38106e9" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:07 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-3844095c-ff49-4ba4-83ff-bf1ee38106e9" released by "delete_volume" :: held 1.164s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:07 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7e1fd42e-29a2-47c8-aa85-1d8b59da054f tempest-ProjectReaderTests-883812902 None] Created volume successfully. Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['1f655f3f-996e-4005-9383-3e67d32f776f', '3bb46c11-c993-49ec-a995-42ea66064e3d', 'aeeafb0e-75c8-479b-a082-f4fa67d2e061', '0776c9f3-5c7d-436e-b7a4-42b2bb5f7faa'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:08 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:08 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:08 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.303s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ed8124ca-b2ce-4458-aa0c-7efe1a97f4f6 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-3844095c-ff49-4ba4-83ff-bf1ee38106e9-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Creating offline snapshot 07f84fca-48f2-4976-94d4-2e978f5ff0b2 of volume 534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2c00e4-5d94-4e68-9312-fbebd112984c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-48e095c3-39f5-47cf-92da-7c13b33ce6a5-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-48e095c3-39f5-47cf-92da-7c13b33ce6a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:09 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 Sep 25 13:02:09 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-48e095c3-39f5-47cf-92da-7c13b33ce6a5" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-48e095c3-39f5-47cf-92da-7c13b33ce6a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5514025-78af-4f02-a275-474bf76b3fc3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:09 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 Sep 25 13:02:09 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:09 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5" returned: 0 in 0.677s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:09 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 1G Sep 25 13:02:09 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:09 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5" returned: 0 in 0.555s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5 Sep 25 13:02:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:10 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-48e095c3-39f5-47cf-92da-7c13b33ce6a5" returned: 0 in 0.373s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-48e095c3-39f5-47cf-92da-7c13b33ce6a5" released by "delete_volume" :: held 1.003s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['738714a5-8918-44c8-8404-65c1976b2a66', 'af0228f1-06bd-4505-bafc-30c9ee5dfa13', 'b345b2a6-425b-4e64-b905-45525c22d3ee', '75a5a816-d647-498f-82d0-2d8db31859b5'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:10 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 1G" returned: 0 in 0.739s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534470d8-5adf-4ed0-9303-fefc230a92b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:10 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534470d8-5adf-4ed0-9303-fefc230a92b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 Sep 25 13:02:10 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:10 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:10 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:10 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534470d8-5adf-4ed0-9303-fefc230a92b5 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2" returned: 0 in 0.480s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:10 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 is being set with open permissions: ugo+rw Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:10 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.297s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:10 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 Sep 25 13:02:10 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-27a4160c-bf75-4ef9-b419-87a4d6e8ca62 tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-48e095c3-39f5-47cf-92da-7c13b33ce6a5-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:11 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2" returned: 0 in 0.300s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:11 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info Sep 25 13:02:11 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-ff561ed2-fb4d-4574-9858-e29994384df9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-ff561ed2-fb4d-4574-9858-e29994384df9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:11 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info" returned: 0 in 0.398s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:11 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info is being set with open permissions: ugo+rw Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-ff561ed2-fb4d-4574-9858-e29994384df9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:11 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info Sep 25 13:02:11 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-ff561ed2-fb4d-4574-9858-e29994384df9" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e399fb-4d36-4464-9344-02b518dd9dac]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:11 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 Sep 25 13:02:11 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:11 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.info" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d66a2a75-50d5-4e78-8259-ead0fec7eea3 tempest-ProjectReaderTests-883812902 None] Create snapshot completed successfully Sep 25 13:02:12 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9" returned: 0 in 0.561s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:12 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9 Sep 25 13:02:12 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:12 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-ff561ed2-fb4d-4574-9858-e29994384df9" returned: 0 in 0.334s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-ff561ed2-fb4d-4574-9858-e29994384df9" released by "delete_volume" :: held 0.966s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['1e4caf08-5a73-42c0-b8e8-678977b74ef7', '1ca444a1-2fe5-45b7-b60c-4ef01a651a08', '48c49f08-f740-44bb-8b1f-11001125fdf2', '25543b5d-66d7-4734-8b7b-89d6979e541e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b1e92826-708c-454f-8ad5-d0173d8a0fbd tempest-ProjectAdminTests-1649325120 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4082221984863, 'free_capacity_gb': 1775.4082221984863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87094) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-07f84fca-48f2-4976-94d4-2e978f5ff0b2-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-07f84fca-48f2-4976-94d4-2e978f5ff0b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-07f84fca-48f2-4976-94d4-2e978f5ff0b2" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-07f84fca-48f2-4976-94d4-2e978f5ff0b2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Deleting offline snapshot 07f84fca-48f2-4976-94d4-2e978f5ff0b2 of volume 534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] snapshot_file for this snap is: volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f522d-3099-4834-8098-100236f49598]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:12 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:12 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:12 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 Sep 25 13:02:12 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:13 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.355s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2f2da8a4-9d01-43c5-96a1-ec39933b7a2e tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-ff561ed2-fb4d-4574-9858-e29994384df9-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:13 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2" returned: 0 in 0.454s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-534470d8-5adf-4ed0-9303-fefc230a92b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771da7d-b25d-4ad1-a618-66eba730704e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:13 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 Sep 25 13:02:13 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-b54394cf-3476-4c9a-8ca1-624e840afd6a-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-b54394cf-3476-4c9a-8ca1-624e840afd6a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:UPDATE=255,cinder:SELECT=191,cinder:INSERT=75,cinder:DELETE=17 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=187,cinder:UPDATE=269,cinder:DELETE=31,cinder:INSERT=58 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:02:13 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5" returned: 0 in 0.501s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:13 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 Sep 25 13:02:13 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "cinder-quobyte-b54394cf-3476-4c9a-8ca1-624e840afd6a" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-b54394cf-3476-4c9a-8ca1-624e840afd6a" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50bb378-9a2d-4396-a46c-b5f75765736d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:14 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a Sep 25 13:02:14 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:14 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2" returned: 0 in 0.551s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:14 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2 Sep 25 13:02:14 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:14 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a" returned: 0 in 0.608s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:14 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a Sep 25 13:02:14 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:14 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5.07f84fca-48f2-4976-94d4-2e978f5ff0b2" returned: 0 in 0.410s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-07f84fca-48f2-4976-94d4-2e978f5ff0b2" released by "_delete_snapshot" :: held 2.106s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" released by "delete_snapshot" :: held 2.154s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:14 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Created reservations ['4c5217cf-6866-4d93-bc52-034c8143896b', '0fed51c7-aac7-4657-96cc-11e0fbffbdc2', 'e6ffb800-a0ba-45ea-aaf5-46deb4805b46', '008fd3fe-2436-4e13-b04f-8932a8313340'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:15 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b54394cf-3476-4c9a-8ca1-624e840afd6a" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-quobyte-b54394cf-3476-4c9a-8ca1-624e840afd6a" released by "delete_volume" :: held 1.094s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Delete snapshot completed successfully. Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d61a8162-ffcd-4231-a7a1-5cf271b0b1f2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-07f84fca-48f2-4976-94d4-2e978f5ff0b2-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Created reservations ['afb9fa26-40f0-4c7b-8e20-dfcb7cb7bde3', 'e460068d-28ef-43fe-93f4-0e119dd61d7d', '5a9973e9-207b-4ade-b3a7-041692843045', '41bcaba7-3c10-482f-b2be-37222c8dd0fb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:15 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:15 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:15 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.292s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Deleted volume successfully. Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-93c36e34-fdb1-4422-8620-d6ca36002aeb tempest-CreateVolumesFromSourceVolumeTest-285464526 None] Lock "cinder-b54394cf-3476-4c9a-8ca1-624e840afd6a-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-534470d8-5adf-4ed0-9303-fefc230a92b5-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "cinder-534470d8-5adf-4ed0-9303-fefc230a92b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a937e3bf-fa00-4c47-ba91-2f8ecfc4e515]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:16 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 Sep 25 13:02:16 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:16 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5" returned: 0 in 0.551s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:16 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5 Sep 25 13:02:16 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:17 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-534470d8-5adf-4ed0-9303-fefc230a92b5" returned: 0 in 0.324s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-534470d8-5adf-4ed0-9303-fefc230a92b5" released by "delete_volume" :: held 0.993s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Created reservations ['09ca9b8f-2d34-4657-9f37-4d0332ee368d', '84d895ec-a50a-48f2-b43c-160ff7ce20a1', 'a29bb4b3-7e95-461a-a50b-fd0aef1d8028', '0e7e4b7d-486a-4355-b1c8-83d3bac18264'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:17 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:17 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:17 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Deleted volume successfully. Sep 25 13:02:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-c7c8c5f4-6ddc-49d2-9ce3-4923195f24be tempest-ProjectReaderTests-883812902 None] Lock "cinder-534470d8-5adf-4ed0-9303-fefc230a92b5-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (61a251ab-5261-415c-b079-69f2788b0c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d996a-7ed1-4b49-9f22-4a20d9445f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d996a-7ed1-4b49-9f22-4a20d9445f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790905165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3edf599-3f97-49ba-8ad7-35a1db92cbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:19Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727eee68-210f-4cd4-8f01-f2f3fe683b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727eee68-210f-4cd4-8f01-f2f3fe683b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954a9f1b-7b4c-4e11-937a-bab5f5addddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954a9f1b-7b4c-4e11-937a-bab5f5addddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3edf599-3f97-49ba-8ad7-35a1db92cbd9', 'volume_name': 'volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a31a3b-00b4-431d-872d-a0311989363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a31a3b-00b4-431d-872d-a0311989363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2875978b-994e-4a25-a9d7-cee5c6fc9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:19 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Volume b3edf599-3f97-49ba-8ad7-35a1db92cbd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9', 'volume_size': 1} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790905165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3edf599-3f97-49ba-8ad7-35a1db92cbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:19Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Creating volume b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:19 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:19 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 1073741824 Sep 25 13:02:19 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:20 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 1073741824" returned: 0 in 0.628s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:20 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 Sep 25 13:02:20 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:20 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" returned: 0 in 0.474s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2875978b-994e-4a25-a9d7-cee5c6fc9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c2ec4b-6505-4191-bc16-25b66462b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Volume volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 (b3edf599-3f97-49ba-8ad7-35a1db92cbd9): created successfully Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c2ec4b-6505-4191-bc16-25b66462b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (61a251ab-5261-415c-b079-69f2788b0c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-96875a48-700d-419a-b312-7f355817e6cc tempest-ProjectReaderTests-883812902 None] Created volume successfully. Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Flow 'volume_create_manager' (d4e95e30-a4b2-439b-ad3d-7a035ecbf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058b0ee-6237-48f2-900c-634d1d4d33f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058b0ee-6237-48f2-900c-634d1d4d33f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503066634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d414f3-adb9-4baf-8e5d-492f5b63b105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528068a68c3b405b9de9f86b8e681e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:21Z,use_quota=True,user_id='111da1707cab455cac954227624bfdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135babea-fb5e-4f28-b1ba-3fedf7abb2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135babea-fb5e-4f28-b1ba-3fedf7abb2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16a401-86f2-4ec6-8e40-a3610d15e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16a401-86f2-4ec6-8e40-a3610d15e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d414f3-adb9-4baf-8e5d-492f5b63b105', 'volume_name': 'volume-21d414f3-adb9-4baf-8e5d-492f5b63b105', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88caf1f8-8c3b-4826-834f-daa7c32cb08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88caf1f8-8c3b-4826-834f-daa7c32cb08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee09097a-d618-4c8d-822b-43b4b512fdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:20 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Volume 21d414f3-adb9-4baf-8e5d-492f5b63b105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d414f3-adb9-4baf-8e5d-492f5b63b105', 'volume_size': 1} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503066634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d414f3-adb9-4baf-8e5d-492f5b63b105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528068a68c3b405b9de9f86b8e681e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:21Z,use_quota=True,user_id='111da1707cab455cac954227624bfdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Creating volume 21d414f3-adb9-4baf-8e5d-492f5b63b105 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:20 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:20 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 1073741824 Sep 25 13:02:20 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:21 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 1073741824" returned: 0 in 0.611s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:21 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 Sep 25 13:02:21 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:21 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105" returned: 0 in 0.336s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.220s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee09097a-d618-4c8d-822b-43b4b512fdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d414f3-adb9-4baf-8e5d-492f5b63b105', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0462ba75-24b3-49b3-b8da-9e985ffc1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Creating offline snapshot eba16947-916c-4781-918b-b3eb80fe8195 of volume b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Volume volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 (21d414f3-adb9-4baf-8e5d-492f5b63b105): created successfully Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0462ba75-24b3-49b3-b8da-9e985ffc1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Flow 'volume_create_manager' (d4e95e30-a4b2-439b-ad3d-7a035ecbf454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d62e4ac-ee39-42aa-87a5-aa7d44d6fc02]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ce316f26-c535-45f8-ab56-0eb6c58dbe1e tempest-ProjectReaderTests-1627883102 None] Created volume successfully. Sep 25 13:02:22 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 Sep 25 13:02:22 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:22 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" returned: 0 in 0.497s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:22 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 1G Sep 25 13:02:22 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:23 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 1G" returned: 0 in 0.607s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:23 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 Sep 25 13:02:23 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Acquiring lock "cinder-21d414f3-adb9-4baf-8e5d-492f5b63b105-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "cinder-21d414f3-adb9-4baf-8e5d-492f5b63b105-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Acquiring lock "cinder-quobyte-21d414f3-adb9-4baf-8e5d-492f5b63b105" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "cinder-quobyte-21d414f3-adb9-4baf-8e5d-492f5b63b105" acquired by "delete_volume" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5cef2-ae0a-48da-a3ba-d015f3987b2e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:23 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 Sep 25 13:02:23 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:23 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195" returned: 0 in 0.517s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:23 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 is being set with open permissions: ugo+rw Sep 25 13:02:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:23 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 Sep 25 13:02:23 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:24 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105" returned: 0 in 0.702s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:24 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105 Sep 25 13:02:24 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:24 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195" returned: 0 in 0.545s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:24 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info Sep 25 13:02:24 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:24 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-21d414f3-adb9-4baf-8e5d-492f5b63b105" returned: 0 in 0.584s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "cinder-quobyte-21d414f3-adb9-4baf-8e5d-492f5b63b105" released by "delete_volume" :: held 1.382s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:24 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info" returned: 0 in 0.542s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:24 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info is being set with open permissions: ugo+rw Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:24 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info Sep 25 13:02:24 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:24 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Created reservations ['55ebc185-878e-4c0a-abcf-9d0e4f3b774c', 'a41abf5d-031e-4582-a6c9-e5dc4b38ebd3', '43015a5a-9659-4294-b705-6f0d64038266', '8d777c7e-36cd-41f1-86d0-bfce838c4783'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:25 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:25 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Flow 'volume_create_manager' (92ad4b32-a5a6-40d0-9ed4-5b098b6ddfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6222969-b11c-44a7-8211-e2c12a99559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6222969-b11c-44a7-8211-e2c12a99559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d180bdc-e1b9-4097-9619-2809f0bcea8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80eab3f3de744a17a6577d60d69e608a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:25Z,use_quota=True,user_id='27cc8c13216041ed8a886961083cfd5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d79bfd-df24-4cd5-a18e-a9064b9a9ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d79bfd-df24-4cd5-a18e-a9064b9a9ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c29501-fcfc-4da2-8906-b9940a0238e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.image.glance [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Creating Keystone auth plugin from conf {{(pid=87094) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:02:25 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.info" returned: 0 in 0.674s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:25 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.584s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Deleted volume successfully. Sep 25 13:02:25 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-76690c93-fe03-481a-b92b-fc4f46af219d tempest-ProjectReaderTests-883812902 None] Create snapshot completed successfully Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-a6821162-7a57-40f7-b594-19b2b681e13c tempest-ProjectReaderTests-1627883102 None] Lock "cinder-21d414f3-adb9-4baf-8e5d-492f5b63b105-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c29501-fcfc-4da2-8906-b9940a0238e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d180bdc-e1b9-4097-9619-2809f0bcea8a', 'volume_name': 'volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a', 'volume_size': 1, 'image_id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd2d4f0b9845f222b4d3a8c47492b56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80eab3f3de744a17a6577d60d69e608a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39c4288f086c5c9ae805695e3d50640c0f6a52ec2285d238535b8e3c11aa60b2b3d72aca32923a60525b6edcd2f266ffc1baa7176b5d85d5b7efea3fa67b7942', 'id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'created_at': datetime.datetime(2026, 9, 25, 11, 2, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 2, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c8222b-e362-4919-a94c-be240f2c68bf/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1aae44-be9a-425b-b233-ee72b554c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1aae44-be9a-425b-b233-ee72b554c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2580821-cb4c-4d64-85bd-8fde1771a264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:25 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a', 'volume_size': 1, 'image_id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd2d4f0b9845f222b4d3a8c47492b56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80eab3f3de744a17a6577d60d69e608a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39c4288f086c5c9ae805695e3d50640c0f6a52ec2285d238535b8e3c11aa60b2b3d72aca32923a60525b6edcd2f266ffc1baa7176b5d85d5b7efea3fa67b7942', 'id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'created_at': datetime.datetime(2026, 9, 25, 11, 2, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 2, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c8222b-e362-4919-a94c-be240f2c68bf/file', 'properties': {}}, 'image_service': } Sep 25 13:02:25 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Trying to clone 6d180bdc-e1b9-4097-9619-2809f0bcea8a from image c0c8222b-e362-4919-a94c-be240f2c68bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}]). {{(pid=87094) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:02:26 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-eba16947-916c-4781-918b-b3eb80fe8195-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-eba16947-916c-4781-918b-b3eb80fe8195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-eba16947-916c-4781-918b-b3eb80fe8195" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7aa927-bcb9-4742-92a3-7bcc52d81fa5]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-eba16947-916c-4781-918b-b3eb80fe8195" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Deleting offline snapshot eba16947-916c-4781-918b-b3eb80fe8195 of volume b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] snapshot_file for this snap is: volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4e719-5cf7-4876-a59f-bd7f07fae1ab]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:26 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:26 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:26 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 Sep 25 13:02:26 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Flow 'volume_create_manager' (548dd063-21bf-4646-aaa8-f64d18b5dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd42c2ef-6297-472e-9bc5-285534e7b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd42c2ef-6297-472e-9bc5-285534e7b27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39422202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4645bece-eaa8-453d-95dc-9972fafe2111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528068a68c3b405b9de9f86b8e681e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:27Z,use_quota=True,user_id='111da1707cab455cac954227624bfdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2d849-f126-4878-aea5-9faa7611235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b2d849-f126-4878-aea5-9faa7611235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7b12ab-7fe6-4b34-927d-e824004cd246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7b12ab-7fe6-4b34-927d-e824004cd246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4645bece-eaa8-453d-95dc-9972fafe2111', 'volume_name': 'volume-4645bece-eaa8-453d-95dc-9972fafe2111', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647a93e8-c967-4172-9d33-020b18c382e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647a93e8-c967-4172-9d33-020b18c382e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b302c-7e41-42b9-9d78-3774d4aabe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:26 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Volume 4645bece-eaa8-453d-95dc-9972fafe2111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4645bece-eaa8-453d-95dc-9972fafe2111', 'volume_size': 1} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39422202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4645bece-eaa8-453d-95dc-9972fafe2111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528068a68c3b405b9de9f86b8e681e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:27Z,use_quota=True,user_id='111da1707cab455cac954227624bfdf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Creating volume 4645bece-eaa8-453d-95dc-9972fafe2111 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:26 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:26 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 1073741824 Sep 25 13:02:26 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:26 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:27 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195" returned: 0 in 0.785s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d99c00-fe44-4514-beed-7dd6206ab8e7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:27 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:27 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:27 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 Sep 25 13:02:27 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:27 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 1 in 0.601s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Temporary image c0c8222b-e362-4919-a94c-be240f2c68bf is fetched for user 27cc8c13216041ed8a886961083cfd5e. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:02:27 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 1073741824" returned: 0 in 0.888s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796c776-1a19-4fd0-a4cd-c40bb22d4693]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:27 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 Sep 25 13:02:27 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:27 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" returned: 0 in 0.755s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:27 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:27 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 Sep 25 13:02:27 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:27 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:28 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111" returned: 0 in 0.417s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b302c-7e41-42b9-9d78-3774d4aabe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4645bece-eaa8-453d-95dc-9972fafe2111', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8ef7e4-9d45-4287-bf4d-22abebe29790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:28 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Volume volume-4645bece-eaa8-453d-95dc-9972fafe2111 (4645bece-eaa8-453d-95dc-9972fafe2111): created successfully Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8ef7e4-9d45-4287-bf4d-22abebe29790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Flow 'volume_create_manager' (548dd063-21bf-4646-aaa8-f64d18b5dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:28 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bc6475ec-4aaa-44b1-ad84-d86df418dc5b tempest-ProjectReaderTests-1627883102 None] Created volume successfully. Sep 25 13:02:28 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:28 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195" returned: 0 in 0.471s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:28 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195 Sep 25 13:02:28 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:28 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:28 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:28 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9.eba16947-916c-4781-918b-b3eb80fe8195" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-eba16947-916c-4781-918b-b3eb80fe8195" released by "_delete_snapshot" :: held 2.596s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" released by "delete_snapshot" :: held 2.661s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Acquiring lock "cinder-4645bece-eaa8-453d-95dc-9972fafe2111-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:28 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "cinder-4645bece-eaa8-453d-95dc-9972fafe2111-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 1 in 0.464s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d180bdc-e1b9-4097-9619-2809f0bcea8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80eab3f3de744a17a6577d60d69e608a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:25Z,use_quota=True,user_id='27cc8c13216041ed8a886961083cfd5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Creating volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:28 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:28 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1073741824 Sep 25 13:02:28 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Created reservations ['22f0b0ad-637f-4d8c-9f04-0b4b47c26109', '79dd2970-583c-4fec-9c42-1d9799c0cfe0', '0fa3cb3f-98a5-41e6-ade1-d26ef21ea519', 'aa2a4b93-4696-4d15-8d2b-dc991b9e2678'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Acquiring lock "cinder-quobyte-4645bece-eaa8-453d-95dc-9972fafe2111" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:28 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "cinder-quobyte-4645bece-eaa8-453d-95dc-9972fafe2111" acquired by "delete_volume" :: waited 0.035s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5185b6-067c-4d79-9443-27c6f1fc0e2d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Delete snapshot completed successfully. Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ee6243ac-b999-40d5-9457-ba86838e30fc tempest-ProjectReaderTests-883812902 None] Lock "cinder-eba16947-916c-4781-918b-b3eb80fe8195-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:29 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 Sep 25 13:02:29 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:29 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1073741824" returned: 0 in 0.579s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:29 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111" returned: 0 in 0.482s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:29 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a Sep 25 13:02:29 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:29 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111 Sep 25 13:02:29 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-b3edf599-3f97-49ba-8ad7-35a1db92cbd9-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "cinder-b3edf599-3f97-49ba-8ad7-35a1db92cbd9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" acquired by "delete_volume" :: waited 0.049s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8f4353-e0c5-48c3-81a7-568530f5b1b1]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:29 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:30 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4645bece-eaa8-453d-95dc-9972fafe2111" returned: 0 in 0.503s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "cinder-quobyte-4645bece-eaa8-453d-95dc-9972fafe2111" released by "delete_volume" :: held 1.068s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Attempting download of c0c8222b-e362-4919-a94c-be240f2c68bf ((None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}])) to volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 13:02:30 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 Sep 25 13:02:30 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Created reservations ['e8256a77-af44-49e8-85d1-1f047c531d76', 'ff6bc245-bfce-4f85-b934-db93f3f22e96', '16e09bed-4ca1-41bb-8b89-7be804941176', '8b7ac111-db83-448e-a93a-2610265cfc51'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[414af1cd-5f6f-4da8-8ac5-23ba05a762ce]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:30 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:30 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:30 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3 Sep 25 13:02:30 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:30 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" returned: 0 in 0.678s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:30 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9 Sep 25 13:02:30 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:30 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3" returned: 0 in 0.465s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:30 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.366s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:30 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Deleted volume successfully. Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-216701ff-5b4e-41f2-8a9e-c1e3644b26ad tempest-ProjectReaderTests-1627883102 None] Lock "cinder-4645bece-eaa8-453d-95dc-9972fafe2111-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:30 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3 Sep 25 13:02:30 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:30 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-b3edf599-3f97-49ba-8ad7-35a1db92cbd9" released by "delete_volume" :: held 1.153s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Created reservations ['b91f79df-7dcc-48e6-98a9-e6c8e61f1c14', 'cec1a06f-118d-4863-9c63-84c1f2a1550b', '67acb820-6a36-4a19-8341-62cc693a045f', '405aad23-23d3-4b5f-9d0c-e43883582ba6'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:31 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3" returned: 1 in 0.498s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c8222b-e362-4919-a94c-be240f2c68bf_z6axn_q3' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf9ec2-62a1-4ccf-9716-642b2671bebd]: (4, 'raw') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:31 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:31 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:31 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:31 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:31 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Deleted volume successfully. Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-76d1147e-96bb-4d8e-bc9e-2bdd81ccfd19 tempest-ProjectReaderTests-883812902 None] Lock "cinder-b3edf599-3f97-49ba-8ad7-35a1db92cbd9-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:31 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:31 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD Sep 25 13:02:31 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:32 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD" returned: 1 in 0.620s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] c0c8222b-e362-4919-a94c-be240f2c68bf was raw, converting to qcow2 {{(pid=87094) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:32 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a Sep 25 13:02:32 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (5aaec0e1-c58e-48cb-882e-2bcd876240ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4719f3bc-e136-45ac-8bb0-da7b9e230e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4719f3bc-e136-45ac-8bb0-da7b9e230e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002145473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce42861-d96f-4029-a2e4-67e2593cc923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:33Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb193ba-e1f9-426f-b4d8-e17ae80acecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb193ba-e1f9-426f-b4d8-e17ae80acecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787b6a15-20af-4779-bbed-93cf6cda0610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787b6a15-20af-4779-bbed-93cf6cda0610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce42861-d96f-4029-a2e4-67e2593cc923', 'volume_name': 'volume-7ce42861-d96f-4029-a2e4-67e2593cc923', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade087f2-95d9-4ba2-8fb0-80fdc2cec7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade087f2-95d9-4ba2-8fb0-80fdc2cec7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c482f7-2e1e-4695-bfda-f063076d6213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Volume 7ce42861-d96f-4029-a2e4-67e2593cc923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce42861-d96f-4029-a2e4-67e2593cc923', 'volume_size': 1} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002145473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce42861-d96f-4029-a2e4-67e2593cc923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:33Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Creating volume 7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:33 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:33 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 1073741824 Sep 25 13:02:33 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:33 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a" returned: 0 in 0.910s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0c8222b-e362-4919-a94c-be240f2c68bf_eimdyussdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:02:33 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1G Sep 25 13:02:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a 1G" returned: 0 in 0.501s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Downloaded image c0c8222b-e362-4919-a94c-be240f2c68bf ((None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}])) to volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a successfully. {{(pid=87094) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Temporary image c0c8222b-e362-4919-a94c-be240f2c68bf for user 27cc8c13216041ed8a886961083cfd5e is deleted. {{(pid=87094) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.volume_utils [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Marking volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a as bootable. {{(pid=87094) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Copying metadata from image c0c8222b-e362-4919-a94c-be240f2c68bf to 6d180bdc-e1b9-4097-9619-2809f0bcea8a. {{(pid=87094) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Creating volume glance metadata for volume 6d180bdc-e1b9-4097-9619-2809f0bcea8a backed by image c0c8222b-e362-4919-a94c-be240f2c68bf with: {'image_id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fd2d4f0b9845f222b4d3a8c47492b56e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87094) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:02:33 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 1073741824" returned: 0 in 0.703s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2580821-cb4c-4d64-85bd-8fde1771a264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a', 'volume_size': 1, 'image_id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c8222b-e362-4919-a94c-be240f2c68bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd2d4f0b9845f222b4d3a8c47492b56e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80eab3f3de744a17a6577d60d69e608a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '39c4288f086c5c9ae805695e3d50640c0f6a52ec2285d238535b8e3c11aa60b2b3d72aca32923a60525b6edcd2f266ffc1baa7176b5d85d5b7efea3fa67b7942', 'id': 'c0c8222b-e362-4919-a94c-be240f2c68bf', 'created_at': datetime.datetime(2026, 9, 25, 11, 2, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 2, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c8222b-e362-4919-a94c-be240f2c68bf/file', 'properties': {}}, 'image_service': }' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317f28e8-4f9b-4c9a-ad6c-ff71d9c610fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:33 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 Sep 25 13:02:33 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Volume volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a (6d180bdc-e1b9-4097-9619-2809f0bcea8a): created successfully Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317f28e8-4f9b-4c9a-ad6c-ff71d9c610fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Flow 'volume_create_manager' (92ad4b32-a5a6-40d0-9ed4-5b098b6ddfa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:33 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-61d2cc65-86b6-4bc8-a3ef-384ffb512b2a tempest-VolumeImageDependencyTests-1463466180 None] Created volume successfully. Sep 25 13:02:34 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923" returned: 0 in 0.372s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c482f7-2e1e-4695-bfda-f063076d6213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce42861-d96f-4029-a2e4-67e2593cc923', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceba454-9b88-4b64-94e8-2119ec9e4614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Volume volume-7ce42861-d96f-4029-a2e4-67e2593cc923 (7ce42861-d96f-4029-a2e4-67e2593cc923): created successfully Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceba454-9b88-4b64-94e8-2119ec9e4614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (5aaec0e1-c58e-48cb-882e-2bcd876240ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-518417ba-f5fa-4211-8986-93d207fd561b tempest-ProjectReaderTests-883812902 None] Created volume successfully. Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Acquiring lock "cinder-6d180bdc-e1b9-4097-9619-2809f0bcea8a-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "cinder-6d180bdc-e1b9-4097-9619-2809f0bcea8a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Acquiring lock "cinder-quobyte-6d180bdc-e1b9-4097-9619-2809f0bcea8a" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "cinder-quobyte-6d180bdc-e1b9-4097-9619-2809f0bcea8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6e03db-0c63-4103-aef3-18a52347a42d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:34 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a Sep 25 13:02:34 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:35 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a" returned: 0 in 0.550s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:35 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a Sep 25 13:02:35 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Creating offline snapshot 70db2237-8f21-40bc-94fb-36ea630d70c5 of volume 7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5974a3-7de8-492a-bd0f-6cf95eefac25]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:35 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6d180bdc-e1b9-4097-9619-2809f0bcea8a" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:35 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 Sep 25 13:02:35 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "cinder-quobyte-6d180bdc-e1b9-4097-9619-2809f0bcea8a" released by "delete_volume" :: held 1.073s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Created reservations ['4473917e-d011-43d2-a028-ef1a5f85555b', 'f0e6149e-a6f4-499d-8949-c70e4db40794', 'b40bcabe-3c20-4727-ac6a-8d8ca926e9d1', '9ceb6ddf-6f5f-4a4a-8e2a-c1e14e02292a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:35 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:35 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:35 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923" returned: 0 in 0.616s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:35 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 1G Sep 25 13:02:35 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:36 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.390s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:36 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Deleted volume successfully. Sep 25 13:02:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7f4c3105-3041-4be1-be25-2a7e761ad839 tempest-VolumeImageDependencyTests-1463466180 None] Lock "cinder-6d180bdc-e1b9-4097-9619-2809f0bcea8a-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:36 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 1G" returned: 0 in 0.622s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce42861-d96f-4029-a2e4-67e2593cc923 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:36 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce42861-d96f-4029-a2e4-67e2593cc923 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 Sep 25 13:02:36 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:37 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ce42861-d96f-4029-a2e4-67e2593cc923 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5" returned: 0 in 0.473s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:37 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 is being set with open permissions: ugo+rw Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:37 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 Sep 25 13:02:37 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:37 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5" returned: 0 in 0.449s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:37 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info Sep 25 13:02:37 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:37 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info" returned: 0 in 0.377s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:37 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info is being set with open permissions: ugo+rw Sep 25 13:02:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:37 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info Sep 25 13:02:37 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:38 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.info" returned: 0 in 0.340s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.052s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a114be4c-d13a-4286-a5c3-ec03f4e61d56 tempest-ProjectReaderTests-883812902 None] Create snapshot completed successfully Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-70db2237-8f21-40bc-94fb-36ea630d70c5-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-70db2237-8f21-40bc-94fb-36ea630d70c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-70db2237-8f21-40bc-94fb-36ea630d70c5" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-70db2237-8f21-40bc-94fb-36ea630d70c5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Deleting offline snapshot 70db2237-8f21-40bc-94fb-36ea630d70c5 of volume 7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] snapshot_file for this snap is: volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce915ccd-237d-4ee8-b03a-3bbf4fe464a7]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:41 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 Sep 25 13:02:41 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:41 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5" returned: 0 in 0.349s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ce42861-d96f-4029-a2e4-67e2593cc923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9718399-a072-42d6-8ab2-ab3cdb9b92d4]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:41 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 Sep 25 13:02:41 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:41 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923" returned: 0 in 0.373s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:41 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 Sep 25 13:02:41 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:42 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5" returned: 0 in 0.355s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:42 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5 Sep 25 13:02:42 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:42 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923.70db2237-8f21-40bc-94fb-36ea630d70c5" returned: 0 in 0.265s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-70db2237-8f21-40bc-94fb-36ea630d70c5" released by "_delete_snapshot" :: held 1.442s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:42 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" released by "delete_snapshot" :: held 1.466s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:43 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Created reservations ['215c3592-a6fc-4fdd-bb52-390ac4ae218a', 'b2adb3a4-b614-4136-8990-3b55ee28226f', 'dee3961b-1f53-4c52-aa8c-901f700b3646', '6e8131f0-5472-46a6-833e-4d5a891feb18'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Delete snapshot completed successfully. Sep 25 13:02:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3198fe8f-e783-4e5e-8ae7-4252b17e8213 tempest-ProjectReaderTests-883812902 None] Lock "cinder-70db2237-8f21-40bc-94fb-36ea630d70c5-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-7ce42861-d96f-4029-a2e4-67e2593cc923-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "cinder-7ce42861-d96f-4029-a2e4-67e2593cc923-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" acquired by "delete_volume" :: waited 0.014s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab0fb70-f7c8-490e-ad6b-97fc35220aeb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:45 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 Sep 25 13:02:45 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:46 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923" returned: 0 in 0.551s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:46 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923 Sep 25 13:02:46 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:46 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-7ce42861-d96f-4029-a2e4-67e2593cc923" returned: 0 in 0.461s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-7ce42861-d96f-4029-a2e4-67e2593cc923" released by "delete_volume" :: held 1.126s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Created reservations ['b85121e2-89cc-4602-ace8-48728ea00882', '4fcbd1de-cfbb-4b20-a40a-f27c99c0030e', '823676bc-330c-412d-9938-248f7dc9e1ec', '2ef97ae4-ea85-4834-8cc8-db2f8a233645'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:46 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:46 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:47 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.364s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:47 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Deleted volume successfully. Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-abdd7fbb-19a6-44d5-a7b5-94c779f9e2df tempest-ProjectReaderTests-883812902 None] Lock "cinder-7ce42861-d96f-4029-a2e4-67e2593cc923-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:47 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:47 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:47 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.439s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:02:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (2343d817-e81a-4061-8635-092272d725b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8d2876-af27-4754-b041-eb46089d78d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8d2876-af27-4754-b041-eb46089d78d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379416457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304d83d-35cd-4fce-b24c-411f0e5dcb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:48Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7233602-296c-4ab7-8d50-a2b75a0f13c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7233602-296c-4ab7-8d50-a2b75a0f13c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59602f5d-09f5-4ba5-92f1-fda30b66131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59602f5d-09f5-4ba5-92f1-fda30b66131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a304d83d-35cd-4fce-b24c-411f0e5dcb38', 'volume_name': 'volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff7c82-dea4-4e74-a896-77f9dc242d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff7c82-dea4-4e74-a896-77f9dc242d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bf8d31-d40f-494b-abb8-06f58a994f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:48 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Volume a304d83d-35cd-4fce-b24c-411f0e5dcb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38', 'volume_size': 1} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379416457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304d83d-35cd-4fce-b24c-411f0e5dcb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:48Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Creating volume a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:48 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:48 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 1073741824 Sep 25 13:02:48 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (dfe71e30-e74e-49b0-879f-f926d21b4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8be8bc-1b2d-4ed2-91dc-8c381d39a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8be8bc-1b2d-4ed2-91dc-8c381d39a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801736997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9e3896-b21a-45ff-8ab8-8ed1b59bede1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:49Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75e94d3-ffe5-43f1-8f99-16f1d138002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75e94d3-ffe5-43f1-8f99-16f1d138002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0262aac5-fb2e-4b17-9ef9-3fbe644968e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0262aac5-fb2e-4b17-9ef9-3fbe644968e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9e3896-b21a-45ff-8ab8-8ed1b59bede1', 'volume_name': 'volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011574e1-ee0c-4c17-ae23-6bc17077d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011574e1-ee0c-4c17-ae23-6bc17077d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0987c40-5ff6-4e51-883f-611cabb56553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Volume 3c9e3896-b21a-45ff-8ab8-8ed1b59bede1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1', 'volume_size': 1} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 1073741824" returned: 0 in 0.896s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:49 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 Sep 25 13:02:49 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:49 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38" returned: 0 in 0.288s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801736997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9e3896-b21a-45ff-8ab8-8ed1b59bede1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:49Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Creating volume 3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:49 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bf8d31-d40f-494b-abb8-06f58a994f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffce7fe2-a359-4f35-a2fd-77a226083b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:49 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 1073741824 Sep 25 13:02:49 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:49 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Volume volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 (a304d83d-35cd-4fce-b24c-411f0e5dcb38): created successfully Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffce7fe2-a359-4f35-a2fd-77a226083b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:49 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (2343d817-e81a-4061-8635-092272d725b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:49 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-bab76d64-092e-4e06-8959-b95a37f3c1ba tempest-ProjectReaderTests-883812902 None] Created volume successfully. Sep 25 13:02:50 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 1073741824" returned: 0 in 0.589s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:50 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 Sep 25 13:02:50 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:50 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" returned: 0 in 0.366s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.167s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0987c40-5ff6-4e51-883f-611cabb56553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e2faf1-b0ef-4206-9bd2-9d708c07aade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Creating offline snapshot a14af608-20a1-4728-9971-35975e6704e9 of volume a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Volume volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 (3c9e3896-b21a-45ff-8ab8-8ed1b59bede1): created successfully Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e2faf1-b0ef-4206-9bd2-9d708c07aade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (dfe71e30-e74e-49b0-879f-f926d21b4444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d618a-f825-4431-bb4d-be3db9655721]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-b7ac02f7-3961-4326-a16d-d80ba32afc7d tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:02:51 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 Sep 25 13:02:51 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:51 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38" returned: 0 in 0.575s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:51 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 1G Sep 25 13:02:51 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:52 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 1G" returned: 0 in 0.787s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:52 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 Sep 25 13:02:52 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:52 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9" returned: 0 in 0.531s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:52 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 is being set with open permissions: ugo+rw Sep 25 13:02:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:52 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 Sep 25 13:02:52 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:53 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:53 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info Sep 25 13:02:53 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:53 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info" returned: 0 in 0.286s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:53 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info is being set with open permissions: ugo+rw Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:53 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info Sep 25 13:02:53 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:53 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.info" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.827s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Creating offline snapshot fd47ec22-bd32-403b-9503-1b83eae79ff7 of volume 3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:53 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-92909b3c-3b9e-4848-99a1-7a6d16010990 tempest-ProjectReaderTests-883812902 None] Create snapshot completed successfully Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46dbc2d-596f-4587-a01e-0cff58948dcd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:54 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 Sep 25 13:02:54 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Flow 'volume_create_manager' (42c2de99-2ce4-4cc7-89bf-df0421b466c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93695d6-a3e6-4d37-a124-b25398630481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93695d6-a3e6-4d37-a124-b25398630481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-362242818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4698e8a-367f-4fc8-93ef-86e5eb121245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2965459461134d648d3c844832eeda2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:54Z,use_quota=True,user_id='6e0d464cea244de79ff55053d9987460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1cfe42-77b0-49c9-bef9-7d3c7573b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1cfe42-77b0-49c9-bef9-7d3c7573b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d05a6fb-434f-4415-a9bb-de10d8111ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d05a6fb-434f-4415-a9bb-de10d8111ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4698e8a-367f-4fc8-93ef-86e5eb121245', 'volume_name': 'volume-b4698e8a-367f-4fc8-93ef-86e5eb121245', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6580506-9d67-4086-ada2-58cb90c92f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6580506-9d67-4086-ada2-58cb90c92f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee8cdfa-b3d5-4625-99c1-3adbedcabf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:54 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Volume b4698e8a-367f-4fc8-93ef-86e5eb121245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4698e8a-367f-4fc8-93ef-86e5eb121245', 'volume_size': 1} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:54 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" returned: 0 in 0.491s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:54 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 1G Sep 25 13:02:54 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:54 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 1G" returned: 0 in 0.525s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-a14af608-20a1-4728-9971-35975e6704e9-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:54 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 Sep 25 13:02:54 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-a14af608-20a1-4728-9971-35975e6704e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-a14af608-20a1-4728-9971-35975e6704e9" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a14af608-20a1-4728-9971-35975e6704e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Deleting offline snapshot a14af608-20a1-4728-9971-35975e6704e9 of volume a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] snapshot_file for this snap is: volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da2a04f-785a-4d19-bcae-76144a5e814d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:55 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 Sep 25 13:02:55 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:55 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7" returned: 0 in 0.427s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:55 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 is being set with open permissions: ugo+rw Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:55 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 Sep 25 13:02:55 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:55 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9" returned: 0 in 0.445s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[662be70b-6e74-4347-b65a-b1e747d1394d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:55 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7" returned: 0 in 0.268s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:55 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 Sep 25 13:02:55 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:55 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info Sep 25 13:02:55 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:55 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info" returned: 0 in 0.297s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:55 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info is being set with open permissions: ugo+rw Sep 25 13:02:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:55 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38" returned: 0 in 0.411s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:56 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info Sep 25 13:02:56 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:56 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 Sep 25 13:02:56 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:56 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.info" returned: 0 in 0.287s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-362242818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4698e8a-367f-4fc8-93ef-86e5eb121245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2965459461134d648d3c844832eeda2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:54Z,use_quota=True,user_id='6e0d464cea244de79ff55053d9987460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Creating volume b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:02:56 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:56 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 1073741824 Sep 25 13:02:56 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d4d8ad81-7377-4017-bb2a-3ad66f5cf53e tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:02:56 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9" returned: 0 in 0.393s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:56 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9 Sep 25 13:02:56 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:56 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38.a14af608-20a1-4728-9971-35975e6704e9" returned: 0 in 0.294s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a14af608-20a1-4728-9971-35975e6704e9" released by "_delete_snapshot" :: held 1.706s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" released by "delete_snapshot" :: held 1.733s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:56 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 1073741824" returned: 0 in 0.505s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Created reservations ['e5f9922f-e727-489d-9ee9-da279669d34a', '29dbdf52-78cc-4b54-98b1-5789a71788a3', 'e18eca0b-5ebb-4d43-93e8-b803a6c17a70', '5b053d70-bdfd-41fe-b4b0-9d61983dafef'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:56 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:02:56 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:56 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Delete snapshot completed successfully. Sep 25 13:02:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-acc35b33-5ed1-450f-8e2e-137a0a9021b2 tempest-ProjectReaderTests-883812902 None] Lock "cinder-a14af608-20a1-4728-9971-35975e6704e9-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-a304d83d-35cd-4fce-b24c-411f0e5dcb38-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "cinder-a304d83d-35cd-4fce-b24c-411f0e5dcb38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:57 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.334s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee8cdfa-b3d5-4625-99c1-3adbedcabf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4698e8a-367f-4fc8-93ef-86e5eb121245', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab9a45-97d5-4525-ad0a-0b2e914b8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" acquired by "delete_volume" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:57 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Volume volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 (b4698e8a-367f-4fc8-93ef-86e5eb121245): created successfully Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ab9a45-97d5-4525-ad0a-0b2e914b8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Flow 'volume_create_manager' (42c2de99-2ce4-4cc7-89bf-df0421b466c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde75d1b-29e0-45d6-baee-c9896be1b82c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-fd47ec22-bd32-403b-9503-1b83eae79ff7-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-27bdb028-ee56-4879-8f64-9258bcad5510 tempest-SnapshotDependencyTests-1890334626 None] Created volume successfully. Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-fd47ec22-bd32-403b-9503-1b83eae79ff7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-fd47ec22-bd32-403b-9503-1b83eae79ff7" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-fd47ec22-bd32-403b-9503-1b83eae79ff7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot fd47ec22-bd32-403b-9503-1b83eae79ff7 of volume 3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126ecf1-389a-4bc4-b0a5-579deac3cf0c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:57 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 Sep 25 13:02:57 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:57 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 Sep 25 13:02:57 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:57 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:57 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38 Sep 25 13:02:57 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:57 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7" returned: 0 in 0.398s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36892f4-a042-456b-8379-49cb5d08103d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:57 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 Sep 25 13:02:57 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:58 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-a304d83d-35cd-4fce-b24c-411f0e5dcb38" returned: 0 in 0.273s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-a304d83d-35cd-4fce-b24c-411f0e5dcb38" released by "delete_volume" :: held 0.829s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Created reservations ['c9cd2190-9b9b-46f5-97fb-2212bb8049a9', 'db99c781-8f14-439a-948f-c1a9a36c08a7', '6940006d-fe50-4842-8e5e-20673c00f934', '3337f714-af15-4700-a0e0-54853956970e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:58 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:02:58 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:58 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:58 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 Sep 25 13:02:58 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:58 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.356s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Deleted volume successfully. Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-db441f87-b42a-4b0e-9018-a1dab83bbc9f tempest-ProjectReaderTests-883812902 None] Lock "cinder-a304d83d-35cd-4fce-b24c-411f0e5dcb38-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:58 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7" returned: 0 in 0.475s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:58 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7 Sep 25 13:02:58 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:59 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1.fd47ec22-bd32-403b-9503-1b83eae79ff7" returned: 0 in 0.273s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (478be2fb-3649-41be-9ced-fa740e3b0336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f879ccfa-8da7-4609-88e4-6d3a9c81bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Creating offline snapshot 75d46585-a1d5-428f-aad5-cae50ff1d30b of volume b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-fd47ec22-bd32-403b-9503-1b83eae79ff7" released by "_delete_snapshot" :: held 1.776s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f879ccfa-8da7-4609-88e4-6d3a9c81bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894878937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535dc48d-9c00-4acc-8edd-660e7e3428b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:59Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dae581-b123-41c6-a131-52ca0809074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dae581-b123-41c6-a131-52ca0809074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b814ab-6eae-4e12-93bb-684e10202f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b814ab-6eae-4e12-93bb-684e10202f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535dc48d-9c00-4acc-8edd-660e7e3428b0', 'volume_name': 'volume-535dc48d-9c00-4acc-8edd-660e7e3428b0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d057ea-949b-4744-bf8f-d96b1861e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d057ea-949b-4744-bf8f-d96b1861e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47d226-deb5-46d7-b40a-927bf54c2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:02:59 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Volume 535dc48d-9c00-4acc-8edd-660e7e3428b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535dc48d-9c00-4acc-8edd-660e7e3428b0', 'volume_size': 1} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e53c556-9cfb-43ac-b12a-624a3ead7f2b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" released by "delete_snapshot" :: held 1.851s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Created reservations ['bab84aa1-20c6-4cff-bbc9-6cb7758787db', '3b852a9c-8f29-4c06-9b97-331cce18529d', 'bc03476f-025b-48af-b8ae-d05a4bf85dd0', '0ee21c36-6433-407a-8448-0d4cad4526fd'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:59 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:02:59 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:59 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8bdda950-bed1-4921-9949-cedd2b1f38f4 tempest-ProjectMemberTests-345174882 None] Lock "cinder-fd47ec22-bd32-403b-9503-1b83eae79ff7-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "cinder-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" acquired by "delete_volume" :: waited 0.014s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:59 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.423s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c5316-dbad-4195-97b8-caeaf10d0e21]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:59 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b 1G Sep 25 13:02:59 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:59 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 Sep 25 13:02:59 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b 1G" returned: 0 in 0.421s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" returned: 0 in 0.415s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:00 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1 Sep 25 13:03:00 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" returned: 0 in 0.250s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1" released by "delete_volume" :: held 0.739s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:00 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.314s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b is being set with open permissions: ugo+rw Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Created reservations ['cfc5ecce-c955-4e1b-86b3-51088fca03bb', 'a84ec268-89bd-4ee9-bad3-3f2d0973556c', 'f4882ec2-55fe-489b-be0d-c75f0316ecb2', '846c708a-7129-4788-a0f3-426bc1aab4be'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:00 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:00 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:00 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.275s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info Sep 25 13:03:00 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.251s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:00 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a7ad0b9-8eaa-48f3-9fa6-320ba4c8dc39 tempest-ProjectMemberTests-345174882 None] Lock "cinder-3c9e3896-b21a-45ff-8ab8-8ed1b59bede1-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:00 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info" returned: 0 in 0.282s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info is being set with open permissions: ugo+rw Sep 25 13:03:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:01 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info Sep 25 13:03:01 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:01 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (14183686-1ba5-4b4b-8444-ec28b6220276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0883e73-6abd-498f-9a0a-f56a65b4f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.info" returned: 0 in 0.300s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894878937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535dc48d-9c00-4acc-8edd-660e7e3428b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a0a04c8364c69a3db4a20fafad63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:02:59Z,use_quota=True,user_id='88272cb46c1e4148a772a72bb5f44b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Creating volume 535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:01 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0883e73-6abd-498f-9a0a-f56a65b4f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116097604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c1186-29d8-4ebf-a50d-bf3340c67718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:01Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 1073741824 Sep 25 13:03:01 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133c9113-ef83-44d3-ad76-31bd11ba8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133c9113-ef83-44d3-ad76-31bd11ba8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225186e4-8e73-4ab5-bd38-2627794f7c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225186e4-8e73-4ab5-bd38-2627794f7c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4c1186-29d8-4ebf-a50d-bf3340c67718', 'volume_name': 'volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82a40cd-c83f-4267-8857-dda5bd042497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82a40cd-c83f-4267-8857-dda5bd042497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42578685-251c-4fb8-ac4e-cb509bdd59cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Volume 2a4c1186-29d8-4ebf-a50d-bf3340c67718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718', 'volume_size': 1} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f1a634bd-0225-4943-b558-6a87e45a216c tempest-SnapshotDependencyTests-1890334626 None] Create snapshot completed successfully Sep 25 13:03:01 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 1073741824" returned: 0 in 0.458s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:01 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 Sep 25 13:03:01 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:02 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0" returned: 0 in 0.291s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116097604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c1186-29d8-4ebf-a50d-bf3340c67718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:01Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Creating volume 2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:02 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca47d226-deb5-46d7-b40a-927bf54c2192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535dc48d-9c00-4acc-8edd-660e7e3428b0', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb693353-fc05-44ee-8ab4-b0a889a3fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 1073741824 Sep 25 13:03:02 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:02 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Volume volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 (535dc48d-9c00-4acc-8edd-660e7e3428b0): created successfully Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb693353-fc05-44ee-8ab4-b0a889a3fe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Flow 'volume_create_manager' (478be2fb-3649-41be-9ced-fa740e3b0336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:02 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-19a4a5ec-9a15-400c-a27e-7e91267a0616 tempest-ProjectReaderTests-883812902 None] Created volume successfully. Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Flow 'volume_create_manager' (6db61149-ab8d-4a85-a66d-47d599e8d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60fb009-fbd9-44df-a3c9-20650cc923b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 1073741824" returned: 0 in 0.530s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60fb009-fbd9-44df-a3c9-20650cc923b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6129a509-c293-4ca7-9d12-03d5cec3445f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2965459461134d648d3c844832eeda2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75d46585-a1d5-428f-aad5-cae50ff1d30b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:03Z,use_quota=True,user_id='6e0d464cea244de79ff55053d9987460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b282f6-13c8-435d-b71e-9d453564271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b282f6-13c8-435d-b71e-9d453564271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6007a0a9-4324-43cb-87d5-75ea195697b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6007a0a9-4324-43cb-87d5-75ea195697b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6129a509-c293-4ca7-9d12-03d5cec3445f', 'volume_name': 'volume-6129a509-c293-4ca7-9d12-03d5cec3445f', 'volume_size': 1, 'snapshot_id': '75d46585-a1d5-428f-aad5-cae50ff1d30b'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9c6653-ec29-452f-bc51-3308c551ed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9c6653-ec29-452f-bc51-3308c551ed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e36d7e-a5ef-4d30-8f04-82dc8b299975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:02 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Volume 6129a509-c293-4ca7-9d12-03d5cec3445f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6129a509-c293-4ca7-9d12-03d5cec3445f', 'volume_size': 1, 'snapshot_id': '75d46585-a1d5-428f-aad5-cae50ff1d30b'} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:02 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 Sep 25 13:03:02 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:02 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718" returned: 0 in 0.240s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.257s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:02 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b-6129a509-c293-4ca7-9d12-03d5cec3445f" by "_create_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42578685-251c-4fb8-ac4e-cb509bdd59cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c839e59-b5d5-4054-91fd-85894ca77d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b-6129a509-c293-4ca7-9d12-03d5cec3445f" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Creating volume 6129a509-c293-4ca7-9d12-03d5cec3445f from snapshot 75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" by "_copy_volume_from_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:03 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Volume volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 (2a4c1186-29d8-4ebf-a50d-bf3340c67718): created successfully Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c839e59-b5d5-4054-91fd-85894ca77d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (14183686-1ba5-4b4b-8444-ec28b6220276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] snapshot: 75d46585-a1d5-428f-aad5-cae50ff1d30b, volume: 6129a509-c293-4ca7-9d12-03d5cec3445f, {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:03:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c68c98ef-f1f3-4fdd-b322-245c41bafa77 tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1259fb9c-0a15-4a33-9f8f-017c7288f1ef]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:03 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:03 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:03 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.499s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4698e8a-367f-4fc8-93ef-86e5eb121245(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6599b-6dd3-42cb-8b4a-172869ce036e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:03 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:03:03 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:03 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.351s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:03:03 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Creating direct copy from snapshot {{(pid=87094) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:03:04 devstack cinder-volume[87094]: DEBUG cinder.utils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Path /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f not found in is_blk_device check {{(pid=87094) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 13:03:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:04 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f Sep 25 13:03:04 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:10 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f" returned: 0 in 6.163s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.image.image_utils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Image conversion details: src /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f {{(pid=87094) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:03:10 devstack cinder-volume[87094]: INFO cinder.image.image_utils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Converted 1024.00 MB image at 166.09 MB/s Sep 25 13:03:10 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f is being set with open permissions: ugo+rw Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:10 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f Sep 25 13:03:10 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:10 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f" returned: 0 in 0.302s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" released by "_copy_volume_from_snapshot" :: held 7.417s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b-6129a509-c293-4ca7-9d12-03d5cec3445f" released by "_create_volume_from_snapshot" :: held 7.502s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.538s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.070s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Creating offline snapshot 5c665028-24fa-4945-aff9-ca3e23968019 of volume 535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e36d7e-a5ef-4d30-8f04-82dc8b299975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6129a509-c293-4ca7-9d12-03d5cec3445f', 'volume_size': 1, 'snapshot_id': '75d46585-a1d5-428f-aad5-cae50ff1d30b'}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187a466-4f67-4b06-8b52-5e5221af8ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1898f8-7bb8-4995-827a-f27d0ba74a08]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:10 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Volume volume-6129a509-c293-4ca7-9d12-03d5cec3445f (6129a509-c293-4ca7-9d12-03d5cec3445f): created successfully Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187a466-4f67-4b06-8b52-5e5221af8ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Flow 'volume_create_manager' (6db61149-ab8d-4a85-a66d-47d599e8d527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-1a9ee2f0-5711-4c9e-a5a8-4b9e657260b0 tempest-SnapshotDependencyTests-1890334626 None] Created volume successfully. Sep 25 13:03:10 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 Sep 25 13:03:10 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:10 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0" returned: 0 in 0.393s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:11 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 1G Sep 25 13:03:11 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:11 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 1G" returned: 0 in 0.424s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-75d46585-a1d5-428f-aad5-cae50ff1d30b-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:11 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 Sep 25 13:03:11 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-75d46585-a1d5-428f-aad5-cae50ff1d30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Deleting offline snapshot 75d46585-a1d5-428f-aad5-cae50ff1d30b of volume b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] snapshot_file for this snap is: volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63f36de-3a36-4b05-b244-3cca0c0d22a5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:11 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:11 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:11 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:11 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 is being set with open permissions: ugo+rw Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:11 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 Sep 25 13:03:11 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:11 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.381s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4698e8a-367f-4fc8-93ef-86e5eb121245(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8adbc93-655d-410a-8314-f19c6acdd8c3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019" returned: 0 in 0.260s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:03:12 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info Sep 25 13:03:12 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info" returned: 0 in 0.252s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:12 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info is being set with open permissions: ugo+rw Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info Sep 25 13:03:12 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.555s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:12 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.info" returned: 0 in 0.262s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.953s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Creating offline snapshot b9b29935-1b30-416b-b071-9e715c8a986b of volume 2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:12 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5bf885d3-a757-456a-8e2b-fe1d5201ad7d tempest-ProjectReaderTests-883812902 None] Create snapshot completed successfully Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a982e58-9a76-4673-91eb-577c72b0a611]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 Sep 25 13:03:12 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.395s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:12 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b Sep 25 13:03:12 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-5c665028-24fa-4945-aff9-ca3e23968019-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-5c665028-24fa-4945-aff9-ca3e23968019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:12 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-5c665028-24fa-4945-aff9-ca3e23968019" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-5c665028-24fa-4945-aff9-ca3e23968019" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Deleting offline snapshot 5c665028-24fa-4945-aff9-ca3e23968019 of volume 535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] snapshot_file for this snap is: volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[24afdf07-9beb-4951-8e4f-7c2da6e0a613]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718" returned: 0 in 0.441s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b 1G Sep 25 13:03:13 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 Sep 25 13:03:13 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245.75d46585-a1d5-428f-aad5-cae50ff1d30b" returned: 0 in 0.298s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-75d46585-a1d5-428f-aad5-cae50ff1d30b" released by "_delete_snapshot" :: held 1.746s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" released by "delete_snapshot" :: held 1.777s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Created reservations ['2240bdb2-ce38-4617-bd6e-79bbae6ff29a', 'cb1cd5ca-feb0-4c17-b0ea-5fddad738a69', '3400a8c7-9695-4972-b1f3-89c49008c51f', '2b68b121-c38b-4677-a084-7a1919ef6afd'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Delete snapshot completed successfully. Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-8f48b0e2-9b3e-4d83-8800-f96439265c8d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-75d46585-a1d5-428f-aad5-cae50ff1d30b-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:13 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019" returned: 0 in 0.407s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535dc48d-9c00-4acc-8edd-660e7e3428b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d71138-357d-41f1-adac-713314e59b17]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b 1G" returned: 0 in 0.481s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b Sep 25 13:03:13 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-b4698e8a-367f-4fc8-93ef-86e5eb121245-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:13 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-b4698e8a-367f-4fc8-93ef-86e5eb121245-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" acquired by "delete_volume" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0874d29-b556-4d71-a239-7bf04d725d80]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:03:13 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0" returned: 0 in 0.393s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b" returned: 0 in 0.351s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:13 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b is being set with open permissions: ugo+rw Sep 25 13:03:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:13 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 Sep 25 13:03:13 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:13 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b Sep 25 13:03:13 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b" returned: 0 in 0.291s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=119,cinder:INSERT=45,cinder:UPDATE=161,cinder:DELETE=17 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=125,cinder:INSERT=41,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.466s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:14 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245 Sep 25 13:03:14 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:14 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info Sep 25 13:03:14 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019" returned: 0 in 0.435s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:14 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019 Sep 25 13:03:14 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-b4698e8a-367f-4fc8-93ef-86e5eb121245" returned: 0 in 0.286s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-b4698e8a-367f-4fc8-93ef-86e5eb121245" released by "delete_volume" :: held 0.831s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:14 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info" returned: 0 in 0.297s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info is being set with open permissions: ugo+rw Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:14 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info Sep 25 13:03:14 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0.5c665028-24fa-4945-aff9-ca3e23968019" returned: 0 in 0.276s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-5c665028-24fa-4945-aff9-ca3e23968019" released by "_delete_snapshot" :: held 1.617s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Created reservations ['a726978e-49c8-4ece-84ab-b19620526196', 'e8f4c17a-8234-4ff3-9265-fd7551b963d0', '7e48ef71-974c-4b31-b3e8-23d041f0e896', '9d7478a8-8152-406b-9a98-c72ad82651aa'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" released by "delete_snapshot" :: held 1.648s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:14 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:14 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Created reservations ['8e797c86-fe20-4828-934a-d8e34293859a', 'e639a9aa-3a57-4c92-8df4-305c060c69ec', '5b769761-5b4d-41ed-926e-fa5b9d5a61f1', '8044b391-e3d3-4243-9883-4b65f7b04ce7'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-6129a509-c293-4ca7-9d12-03d5cec3445f-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:14 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-6129a509-c293-4ca7-9d12-03d5cec3445f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.info" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-fc384991-3588-4806-998b-0548b758885a tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:03:14 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Delete snapshot completed successfully. Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-89b3e408-ca61-4e3f-bbf0-a52861507551 tempest-ProjectReaderTests-883812902 None] Lock "cinder-5c665028-24fa-4945-aff9-ca3e23968019-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:14 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" acquired by "delete_volume" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6226f69-6f44-4ee8-890d-bba327b2fd97]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.319s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Deleted volume successfully. Sep 25 13:03:15 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f Sep 25 13:03:15 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-535dc48d-9c00-4acc-8edd-660e7e3428b0-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-6550655e-73a6-4f75-9e96-eaf9fe5b420d tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-b4698e8a-367f-4fc8-93ef-86e5eb121245-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "cinder-535dc48d-9c00-4acc-8edd-660e7e3428b0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-b9b29935-1b30-416b-b071-9e715c8a986b-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-b9b29935-1b30-416b-b071-9e715c8a986b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Acquiring lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-b9b29935-1b30-416b-b071-9e715c8a986b" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-b9b29935-1b30-416b-b071-9e715c8a986b" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot b9b29935-1b30-416b-b071-9e715c8a986b of volume 2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3f5cc-700e-4e60-972b-4a7b2afba90d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff02942-7235-4a57-aa1f-53f3efae595a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f" returned: 0 in 0.478s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 Sep 25 13:03:15 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f Sep 25 13:03:15 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:15 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:15 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b Sep 25 13:03:15 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:15 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-6129a509-c293-4ca7-9d12-03d5cec3445f" returned: 0 in 0.284s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-quobyte-6129a509-c293-4ca7-9d12-03d5cec3445f" released by "delete_volume" :: held 0.810s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:15 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0" returned: 0 in 0.425s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0 Sep 25 13:03:15 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:15 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b" returned: 0 in 0.450s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd534f2-f430-4a3b-a1ac-65e50757d61c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:15 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Created reservations ['87db89af-f0fb-41ec-89f0-0ff0f9372f8f', '830ce3ce-d362-4abb-acf3-0c35ae1793c1', '7d978a1f-af04-467f-b17e-71dfe7fe7d9a', '8c34de67-5d49-4a1b-bd99-d1a8ddcf912a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:16 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 Sep 25 13:03:16 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:16 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:16 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:16 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-535dc48d-9c00-4acc-8edd-660e7e3428b0" returned: 0 in 0.345s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "cinder-quobyte-535dc48d-9c00-4acc-8edd-660e7e3428b0" released by "delete_volume" :: held 0.912s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Created reservations ['2945701d-726f-41f0-bea2-032853842eff', '6662e58f-1f35-44d0-9f66-fb5db3144c7f', 'a83c9db5-d8a1-4e50-af63-777edcaed96a', 'd2387799-60cc-4671-950b-af3c3b9b6989'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:16 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.425s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Deleted volume successfully. Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:16 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:16 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:16 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e21897cf-064a-4802-a7af-c346e513c108 tempest-SnapshotDependencyTests-1890334626 None] Lock "cinder-6129a509-c293-4ca7-9d12-03d5cec3445f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718" returned: 0 in 0.634s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:16 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b Sep 25 13:03:16 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:16 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.286s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:16 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Deleted volume successfully. Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-59577e48-155d-4bff-a20f-38adf1f619fe tempest-ProjectReaderTests-883812902 None] Lock "cinder-535dc48d-9c00-4acc-8edd-660e7e3428b0-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:16 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b" returned: 0 in 0.420s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:16 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b Sep 25 13:03:16 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:17 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718.b9b29935-1b30-416b-b071-9e715c8a986b" returned: 0 in 0.305s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-b9b29935-1b30-416b-b071-9e715c8a986b" released by "_delete_snapshot" :: held 1.941s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" released by "delete_snapshot" :: held 2.005s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:17 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Created reservations ['46a40b7b-bfc4-47f2-b88d-6eefd5f33456', '6b7eae82-93cb-40e6-9613-3ad994968475', '4e509d42-13e0-42f5-a0a6-61b8571cf474', '7d7749eb-c931-4df4-a14b-1e19e8b6ad7e'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:17 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:03:17 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-d5ac72d1-2fa0-4a05-9f4e-a3890208a508 tempest-ProjectMemberTests-345174882 None] Lock "cinder-b9b29935-1b30-416b-b071-9e715c8a986b-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-2a4c1186-29d8-4ebf-a50d-bf3340c67718-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "cinder-2a4c1186-29d8-4ebf-a50d-bf3340c67718-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13085a1-6138-4346-88e6-d66baabf3d19]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:18 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 Sep 25 13:03:18 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:19 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718" returned: 0 in 0.466s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:19 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718 Sep 25 13:03:19 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:19 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2a4c1186-29d8-4ebf-a50d-bf3340c67718" returned: 0 in 0.418s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-2a4c1186-29d8-4ebf-a50d-bf3340c67718" released by "delete_volume" :: held 0.984s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Created reservations ['e485d2da-76be-4c57-8499-5c413d653606', 'e07ce420-2e9c-4a67-9595-f32bcd5be35b', 'b8f9375f-e72f-4c3b-a530-ce7ac90badaf', '4d55ad02-d092-49e7-9969-0b7013233dc2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:19 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:19 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:20 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.311s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:20 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-23d535bf-27fc-46ae-b462-dc163231c394 tempest-ProjectMemberTests-345174882 None] Lock "cinder-2a4c1186-29d8-4ebf-a50d-bf3340c67718-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (24b04c6a-4204-4400-97b7-9b63d5642031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b66d61-e7aa-4c44-9c5e-d105821e5441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b66d61-e7aa-4c44-9c5e-d105821e5441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177756655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c37c28-8e61-448c-bdb6-8f9d87396304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:21Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e7232-3f0f-45c7-bc68-23466fa35b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e7232-3f0f-45c7-bc68-23466fa35b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea543a9b-706f-456f-8542-b87e17376e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea543a9b-706f-456f-8542-b87e17376e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c37c28-8e61-448c-bdb6-8f9d87396304', 'volume_name': 'volume-e3c37c28-8e61-448c-bdb6-8f9d87396304', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a28dc29-49f1-46f0-94a4-3e609d86e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a28dc29-49f1-46f0-94a4-3e609d86e705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d49f903-5817-48c1-8c89-7d7d44a1eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:21 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Volume e3c37c28-8e61-448c-bdb6-8f9d87396304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c37c28-8e61-448c-bdb6-8f9d87396304', 'volume_size': 1} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177756655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c37c28-8e61-448c-bdb6-8f9d87396304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:21Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Creating volume e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:21 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:21 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:21 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 1073741824 Sep 25 13:03:21 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:22 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 1073741824" returned: 0 in 0.660s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:22 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 Sep 25 13:03:22 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:22 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304" returned: 0 in 0.293s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d49f903-5817-48c1-8c89-7d7d44a1eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c37c28-8e61-448c-bdb6-8f9d87396304', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b4ff31-7d71-4363-a73e-e8936164d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:22 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Volume volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 (e3c37c28-8e61-448c-bdb6-8f9d87396304): created successfully Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b4ff31-7d71-4363-a73e-e8936164d86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:22 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (24b04c6a-4204-4400-97b7-9b63d5642031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:22 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2c9eff55-ef40-4437-b145-d9706b5515f7 tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:23 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Creating offline snapshot f3d475ff-5184-4971-9e18-693554099fc5 of volume e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:23 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a9b227-8a13-4caa-9afe-4e42abef763d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:23 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:23 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 Sep 25 13:03:23 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:24 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304" returned: 0 in 0.497s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:24 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 1G Sep 25 13:03:24 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:24 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 1G" returned: 0 in 0.552s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:24 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:24 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 Sep 25 13:03:24 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:25 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5" returned: 0 in 0.409s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:25 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 is being set with open permissions: ugo+rw Sep 25 13:03:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:25 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 Sep 25 13:03:25 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:25 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5" returned: 0 in 0.342s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:25 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:25 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info Sep 25 13:03:25 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:26 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info" returned: 0 in 0.326s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:26 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info is being set with open permissions: ugo+rw Sep 25 13:03:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:26 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info Sep 25 13:03:26 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:26 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.info" returned: 0 in 0.278s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:26 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:26 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0212235e-7da0-48ca-8d28-8ab7be99bc51 tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-f3d475ff-5184-4971-9e18-693554099fc5-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-f3d475ff-5184-4971-9e18-693554099fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-f3d475ff-5184-4971-9e18-693554099fc5" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f3d475ff-5184-4971-9e18-693554099fc5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot f3d475ff-5184-4971-9e18-693554099fc5 of volume e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea030c-bb15-4fa4-a6a5-09fcd56e176c]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:27 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 Sep 25 13:03:27 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:27 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5" returned: 0 in 0.511s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c37c28-8e61-448c-bdb6-8f9d87396304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feaf0fc-f625-4c4b-8317-71589c7507a9]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:27 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:27 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 Sep 25 13:03:27 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:28 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304" returned: 0 in 0.541s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:28 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 Sep 25 13:03:28 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:28 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5" returned: 0 in 0.501s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:28 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5 Sep 25 13:03:28 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (88537190-7b99-4854-b71f-a77993cfdb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3305c92-1739-4935-b67e-33131231d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:28 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3305c92-1739-4935-b67e-33131231d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800332462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8e80f4-3b51-4b51-b5b8-af97899affe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:29Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1879fea-8c80-449d-b8e5-cf732fa36e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1879fea-8c80-449d-b8e5-cf732fa36e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554bbf08-c054-4d5b-9d73-683ac3e27424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554bbf08-c054-4d5b-9d73-683ac3e27424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8e80f4-3b51-4b51-b5b8-af97899affe6', 'volume_name': 'volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a1a097-7029-4656-b2fb-534a99f87a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a1a097-7029-4656-b2fb-534a99f87a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1594e9cb-0478-47be-a0e1-d5c305c85110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Volume cc8e80f4-3b51-4b51-b5b8-af97899affe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6', 'volume_size': 1} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800332462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8e80f4-3b51-4b51-b5b8-af97899affe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:29Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Creating volume cc8e80f4-3b51-4b51-b5b8-af97899affe6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:29 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:29 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304.f3d475ff-5184-4971-9e18-693554099fc5" returned: 0 in 0.289s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:29 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 1073741824 Sep 25 13:03:29 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f3d475ff-5184-4971-9e18-693554099fc5" released by "_delete_snapshot" :: held 1.994s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" released by "delete_snapshot" :: held 2.038s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Created reservations ['8133b8bf-a0db-4b25-add3-12712b8cbce1', '09b5e164-39fc-4ea1-98ab-ea85758f8c4c', 'cb9bd59d-4e57-4048-b8d1-cefc62695b09', '3bde78d9-8aa8-4260-84fa-befae7cb0b08'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2a964323-5c06-4fd1-9129-4aa4651da574 tempest-ProjectMemberTests-345174882 None] Lock "cinder-f3d475ff-5184-4971-9e18-693554099fc5-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:29 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 1073741824" returned: 0 in 0.527s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:29 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 Sep 25 13:03:29 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:29 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6" returned: 0 in 0.288s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1594e9cb-0478-47be-a0e1-d5c305c85110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb164715-6105-4061-827e-bc62f446288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:29 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Volume volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 (cc8e80f4-3b51-4b51-b5b8-af97899affe6): created successfully Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb164715-6105-4061-827e-bc62f446288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:29 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (88537190-7b99-4854-b71f-a77993cfdb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:29 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-36a50677-71a5-4189-8bc2-388ff4901fa7 tempest-ProjectReaderTests-2701813 None] Created volume successfully. Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-e3c37c28-8e61-448c-bdb6-8f9d87396304-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "cinder-e3c37c28-8e61-448c-bdb6-8f9d87396304-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" acquired by "delete_volume" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3323eaa-522a-4c76-81e9-4380271abbeb]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:30 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 Sep 25 13:03:30 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:30 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304" returned: 0 in 0.384s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:30 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:30 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304 Sep 25 13:03:30 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:31 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e3c37c28-8e61-448c-bdb6-8f9d87396304" returned: 0 in 0.255s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e3c37c28-8e61-448c-bdb6-8f9d87396304" released by "delete_volume" :: held 0.710s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Created reservations ['3691298e-10cc-4213-8dc3-2bae5b3c10cc', 'd444450b-4cd7-48d3-a403-3eb05f2c5fbe', 'c6949f41-0657-4ac7-9419-48210c429c12', 'fc6cf3f2-c324-40e7-9ea5-b429a03c93db'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:31 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:31 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-cc8e80f4-3b51-4b51-b5b8-af97899affe6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "cinder-cc8e80f4-3b51-4b51-b5b8-af97899affe6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-quobyte-cc8e80f4-3b51-4b51-b5b8-af97899affe6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-cc8e80f4-3b51-4b51-b5b8-af97899affe6" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98af8a8-8da1-41c9-88bb-93ed6498ecdd]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:31 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:31 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:31 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 Sep 25 13:03:31 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-0dfa58c8-51ee-46be-be7d-7e99d8f04742 tempest-ProjectMemberTests-345174882 None] Lock "cinder-e3c37c28-8e61-448c-bdb6-8f9d87396304-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:31 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6" returned: 0 in 0.429s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:31 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:32 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6 Sep 25 13:03:32 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (6e92da3e-c6d3-4069-bda8-54e5b5fc333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f67fc1-335a-499f-b03d-1d1caaf10da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f67fc1-335a-499f-b03d-1d1caaf10da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990736226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8c19c8-1b84-462f-a1db-66e779ce3bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:32Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4164e02e-f9e3-4050-8da2-4429002ccc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4164e02e-f9e3-4050-8da2-4429002ccc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10df74f3-76b8-4b08-bcb1-3e5bbdb71e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10df74f3-76b8-4b08-bcb1-3e5bbdb71e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8c19c8-1b84-462f-a1db-66e779ce3bf2', 'volume_name': 'volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04113f36-0c0c-4ba4-85c0-83082cd93fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04113f36-0c0c-4ba4-85c0-83082cd93fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12dbf99-706e-4a20-8a54-7fbeaade6b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:32 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Volume de8c19c8-1b84-462f-a1db-66e779ce3bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2', 'volume_size': 1} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990736226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8c19c8-1b84-462f-a1db-66e779ce3bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:32Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Creating volume de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:32 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:32 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 1073741824 Sep 25 13:03:32 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:32 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-cc8e80f4-3b51-4b51-b5b8-af97899affe6" returned: 0 in 0.262s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-cc8e80f4-3b51-4b51-b5b8-af97899affe6" released by "delete_volume" :: held 0.758s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Created reservations ['3626776e-667e-4066-9e8c-55d211b8d722', 'f76c2873-e8b3-4d71-8220-7e2153743cba', 'ba267aff-c7d4-46a0-9335-652c2b3eed6d', '3d5abb92-674e-45e6-a477-dd33b995a17f'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:32 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:32 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:32 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:32 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.277s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 1073741824" returned: 0 in 0.514s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:32 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Deleted volume successfully. Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-ae9747e3-1712-4640-8c1a-b982d2f53c8c tempest-ProjectReaderTests-2701813 None] Lock "cinder-cc8e80f4-3b51-4b51-b5b8-af97899affe6-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:32 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:32 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 Sep 25 13:03:32 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:33 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2" returned: 0 in 0.337s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12dbf99-706e-4a20-8a54-7fbeaade6b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a29d9c1-bf2d-4898-a180-83f6fe8a87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Volume volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 (de8c19c8-1b84-462f-a1db-66e779ce3bf2): created successfully Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a29d9c1-bf2d-4898-a180-83f6fe8a87c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (6e92da3e-c6d3-4069-bda8-54e5b5fc333b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:33 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-cc161c78-b8ca-4e34-aab8-e2b725557b09 tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (d7000be3-c6ae-49ce-b6c8-870cab7fe07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bdd6d-97b7-4abe-b561-bb0baef1ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bdd6d-97b7-4abe-b561-bb0baef1ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791421045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2975eb93-eb43-4641-a320-686a43aec7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:33Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abdfa13-5049-4265-b91b-c56e80438946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abdfa13-5049-4265-b91b-c56e80438946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561c827-e17b-4845-9bf8-27e857249b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561c827-e17b-4845-9bf8-27e857249b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2975eb93-eb43-4641-a320-686a43aec7fd', 'volume_name': 'volume-2975eb93-eb43-4641-a320-686a43aec7fd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74ba9a7-0539-4187-905f-6c2d51faffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74ba9a7-0539-4187-905f-6c2d51faffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b18c93-4324-42e4-9acb-5216ef876849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:33 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Volume 2975eb93-eb43-4641-a320-686a43aec7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2975eb93-eb43-4641-a320-686a43aec7fd', 'volume_size': 1} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-791421045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2975eb93-eb43-4641-a320-686a43aec7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:33Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Creating volume 2975eb93-eb43-4641-a320-686a43aec7fd {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:33 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:33 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd 1073741824 Sep 25 13:03:33 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:33 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd 1073741824" returned: 0 in 0.454s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:33 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:33 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd Sep 25 13:03:33 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:34 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd" returned: 0 in 0.305s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b18c93-4324-42e4-9acb-5216ef876849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2975eb93-eb43-4641-a320-686a43aec7fd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67059d-8ec7-4e3b-80c9-c5b891f55406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:34 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Volume volume-2975eb93-eb43-4641-a320-686a43aec7fd (2975eb93-eb43-4641-a320-686a43aec7fd): created successfully Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67059d-8ec7-4e3b-80c9-c5b891f55406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (d7000be3-c6ae-49ce-b6c8-870cab7fe07d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:34 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f777d632-f235-4d8e-b57a-d6285f009be7 tempest-ProjectReaderTests-2701813 None] Created volume successfully. Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Creating offline snapshot 7d61b04f-024f-4248-bcd6-d9a12b51907d of volume de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50004a5-c7c0-4dfa-8263-582017139db8]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:34 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 Sep 25 13:03:34 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:34 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:34 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:34 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d 1G Sep 25 13:03:34 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:35 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d 1G" returned: 0 in 0.453s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:35 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d Sep 25 13:03:35 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-2975eb93-eb43-4641-a320-686a43aec7fd-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "cinder-2975eb93-eb43-4641-a320-686a43aec7fd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-quobyte-2975eb93-eb43-4641-a320-686a43aec7fd" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-2975eb93-eb43-4641-a320-686a43aec7fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb275bca-4bf0-4b6d-854a-afa9734f0eef]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:35 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd Sep 25 13:03:35 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:35 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d" returned: 0 in 0.413s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:35 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d is being set with open permissions: ugo+rw Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:35 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d Sep 25 13:03:35 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:35 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd" returned: 0 in 0.433s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:35 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:35 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd Sep 25 13:03:36 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:36 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d" returned: 0 in 0.303s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:36 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info Sep 25 13:03:36 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:36 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-2975eb93-eb43-4641-a320-686a43aec7fd" returned: 0 in 0.308s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-2975eb93-eb43-4641-a320-686a43aec7fd" released by "delete_volume" :: held 0.795s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Created reservations ['00cfe7b0-3db5-4057-887c-7c8aa1681ceb', '72871cbb-257a-441e-9b35-9bc3be884a6c', 'b3ec264f-4ea8-46ca-8a6c-9840970af5fb', '763f0ad4-e195-409e-98f1-9e8fae1aa869'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:36 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info" returned: 0 in 0.319s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:36 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info is being set with open permissions: ugo+rw Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:36 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info Sep 25 13:03:36 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:36 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:36 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:36 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.info" returned: 0 in 0.343s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:36 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2384bf73-ecc8-4647-b9aa-dbcafdedb084 tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.329s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:36 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Deleted volume successfully. Sep 25 13:03:36 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-7428357c-8712-41a7-b65d-3c6da377f747 tempest-ProjectReaderTests-2701813 None] Lock "cinder-2975eb93-eb43-4641-a320-686a43aec7fd-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (16593308-a83a-4e4f-9f6b-b24da5d17153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0309a90-d68d-4c1b-be6b-f4e33a5db579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0309a90-d68d-4c1b-be6b-f4e33a5db579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0270e4-9a7f-4c9b-9436-bf1e837bdffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:37Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19da05df-ed0f-49aa-aee4-b834cf1eb36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19da05df-ed0f-49aa-aee4-b834cf1eb36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2f45fc-e75c-4d76-a8ad-d7c098d7727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2f45fc-e75c-4d76-a8ad-d7c098d7727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0270e4-9a7f-4c9b-9436-bf1e837bdffd', 'volume_name': 'volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc26e555-0734-45e1-8afa-66efb76aaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc26e555-0734-45e1-8afa-66efb76aaff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f040e6-e986-4c07-8d2a-1f2a8fc56ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:37 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Volume fb0270e4-9a7f-4c9b-9436-bf1e837bdffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd', 'volume_size': 1} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0270e4-9a7f-4c9b-9436-bf1e837bdffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:37Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Creating volume fb0270e4-9a7f-4c9b-9436-bf1e837bdffd {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:37 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:37 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd 1073741824 Sep 25 13:03:37 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-7d61b04f-024f-4248-bcd6-d9a12b51907d-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-7d61b04f-024f-4248-bcd6-d9a12b51907d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-7d61b04f-024f-4248-bcd6-d9a12b51907d" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:37 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd 1073741824" returned: 0 in 0.476s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-7d61b04f-024f-4248-bcd6-d9a12b51907d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot 7d61b04f-024f-4248-bcd6-d9a12b51907d of volume de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a58b3e5-ffcd-4f06-b8d9-c949b390245e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:37 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:37 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd Sep 25 13:03:37 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:37 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d Sep 25 13:03:37 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:38 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" returned: 0 in 0.285s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f040e6-e986-4c07-8d2a-1f2a8fc56ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1cdba7-c259-4729-b88c-01f0338c2ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:38 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Volume volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd (fb0270e4-9a7f-4c9b-9436-bf1e837bdffd): created successfully Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1cdba7-c259-4729-b88c-01f0338c2ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (16593308-a83a-4e4f-9f6b-b24da5d17153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:38 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:38 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-5f313455-257a-47b3-9f29-bf7621a0e1ba tempest-ProjectReaderTests-2701813 None] Created volume successfully. Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d" returned: 0 in 0.391s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febcfb2-4bc4-4e57-a2fa-5341c0b94eb5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:38 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 Sep 25 13:03:38 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:38 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2" returned: 0 in 0.367s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:38 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d Sep 25 13:03:38 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:38 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d" returned: 0 in 0.341s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:38 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:38 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d Sep 25 13:03:38 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:39 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2.7d61b04f-024f-4248-bcd6-d9a12b51907d" returned: 0 in 0.262s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-7d61b04f-024f-4248-bcd6-d9a12b51907d" released by "_delete_snapshot" :: held 1.465s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" released by "delete_snapshot" :: held 1.491s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Created reservations ['bf83ab34-fb51-4d90-9290-2b9d1d1e8dff', 'bd01b044-f862-4593-963f-21a55d3bf352', 'ef392660-fbea-4d15-8fc5-692c07cacaed', '0df58697-3a87-4951-8dba-f1d2d83beb96'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:39 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e5bae716-87d9-4fa0-89c2-2ef7110a8be9 tempest-ProjectMemberTests-345174882 None] Lock "cinder-7d61b04f-024f-4248-bcd6-d9a12b51907d-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "cinder-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-quobyte-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" acquired by "delete_volume" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[88764ca7-8cad-4fab-a1f9-a50c5942072b]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:39 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd Sep 25 13:03:39 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-de8c19c8-1b84-462f-a1db-66e779ce3bf2-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:39 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "cinder-de8c19c8-1b84-462f-a1db-66e779ce3bf2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" returned: 0 in 0.394s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:39 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd Sep 25 13:03:39 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" acquired by "delete_volume" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f39ad8-650d-445e-bdae-4093d4ccaa62]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:39 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:40 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 Sep 25 13:03:40 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:40 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" returned: 0 in 0.320s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd" released by "delete_volume" :: held 0.760s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Created reservations ['9eca0417-9d0a-41f6-bec9-eb8c45e4e42b', '980cdc3f-e3c9-4a61-8bc8-47f1993f8e0d', '2b11f123-0678-4c61-b2ab-0dd01f4f5341', 'b78d3aa2-7dd0-4659-bcdc-03c0bdb19bb2'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:40 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:40 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:40 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2" returned: 0 in 0.434s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:40 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2 Sep 25 13:03:40 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:40 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.285s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:40 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Deleted volume successfully. Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-45beb4b7-275f-429a-b076-abdb545c0ff1 tempest-ProjectReaderTests-2701813 None] Lock "cinder-fb0270e4-9a7f-4c9b-9436-bf1e837bdffd-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:40 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-de8c19c8-1b84-462f-a1db-66e779ce3bf2" returned: 0 in 0.290s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-de8c19c8-1b84-462f-a1db-66e779ce3bf2" released by "delete_volume" :: held 0.790s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Created reservations ['648efa69-7158-4e7f-8516-b4ccd96b8362', '8b5ab99f-8cb1-4f65-b6cd-380131847d8e', '073c46b5-f8e7-4584-b059-87e6de44d761', '7fdd94f0-03b5-43d6-abe8-685963b6b306'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:40 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:40 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:40 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (4ce4bb68-561a-423b-85ac-b06b347dee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c38310-2be0-4800-8d9b-4827484eeb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c38310-2be0-4800-8d9b-4827484eeb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691390277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d9c6aa-9b74-481e-b0dc-06dd3468a8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:41Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8fa49-ab78-4147-b36d-11c92d43a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8fa49-ab78-4147-b36d-11c92d43a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa85368b-f35b-4ee7-959a-22c0a5bd334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa85368b-f35b-4ee7-959a-22c0a5bd334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d9c6aa-9b74-481e-b0dc-06dd3468a8c2', 'volume_name': 'volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8b4cec-9541-482f-9f25-1e1db11848be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8b4cec-9541-482f-9f25-1e1db11848be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82728f5-1392-4329-9a35-385fe9f45cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Volume 53d9c6aa-9b74-481e-b0dc-06dd3468a8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2', 'volume_size': 1} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691390277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d9c6aa-9b74-481e-b0dc-06dd3468a8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9020785f29149cfb69966d031743b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:41Z,use_quota=True,user_id='7f984de944d2481fac9e963185f95c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Creating volume 53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:41 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.385s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:41 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:41 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 1073741824 Sep 25 13:03:41 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-afbd78df-98bd-4fd0-b540-920b036a6d9c tempest-ProjectMemberTests-345174882 None] Lock "cinder-de8c19c8-1b84-462f-a1db-66e779ce3bf2-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (33dae01b-df16-4e42-914d-dd37ef5fd731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd3a344-7af2-4e47-8f97-f1f12dcf92d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd3a344-7af2-4e47-8f97-f1f12dcf92d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486690997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465517f3-4729-4fef-a00d-545c75e6ae2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:42Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ff776a-d359-487a-8f96-1e3a343940d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ff776a-d359-487a-8f96-1e3a343940d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc6ebe-8e71-4985-8505-f1343108f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc6ebe-8e71-4985-8505-f1343108f41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465517f3-4729-4fef-a00d-545c75e6ae2c', 'volume_name': 'volume-465517f3-4729-4fef-a00d-545c75e6ae2c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0547cd-57d3-41ca-aef7-6ce6f1a1fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0547cd-57d3-41ca-aef7-6ce6f1a1fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8335cea-b2dd-4dfb-a95b-11b157652677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:41 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Volume 465517f3-4729-4fef-a00d-545c75e6ae2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465517f3-4729-4fef-a00d-545c75e6ae2c', 'volume_size': 1} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:41 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 1073741824" returned: 0 in 0.546s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:41 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:41 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 Sep 25 13:03:41 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:42 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" returned: 0 in 0.284s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486690997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465517f3-4729-4fef-a00d-545c75e6ae2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:42Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Creating volume 465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:42 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82728f5-1392-4329-9a35-385fe9f45cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:42 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c 1073741824 Sep 25 13:03:42 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ead51b-79eb-4c46-aa25-222747a2f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Volume volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 (53d9c6aa-9b74-481e-b0dc-06dd3468a8c2): created successfully Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ead51b-79eb-4c46-aa25-222747a2f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Flow 'volume_create_manager' (4ce4bb68-561a-423b-85ac-b06b347dee21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-558d9e05-33a4-43fe-b772-528a433e6a0a tempest-ProjectReaderTests-2701813 None] Created volume successfully. Sep 25 13:03:42 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c 1073741824" returned: 0 in 0.476s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:42 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c Sep 25 13:03:42 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:42 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c" returned: 0 in 0.270s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8335cea-b2dd-4dfb-a95b-11b157652677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465517f3-4729-4fef-a00d-545c75e6ae2c', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d66425e-6b42-4913-8f4f-8ecbdf7a6e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:42 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Volume volume-465517f3-4729-4fef-a00d-545c75e6ae2c (465517f3-4729-4fef-a00d-545c75e6ae2c): created successfully Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d66425e-6b42-4913-8f4f-8ecbdf7a6e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:42 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (33dae01b-df16-4e42-914d-dd37ef5fd731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:42 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-c07c2213-9814-40dc-9424-b8ea0f59037b tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "cinder-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Acquiring lock "cinder-quobyte-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc4d8c-ada1-4303-b4a3-37e6671d9675]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:43 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 Sep 25 13:03:43 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:43 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" returned: 0 in 0.393s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:43 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2 Sep 25 13:03:43 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Creating offline snapshot ba96bc2a-f403-4d2a-8bb5-10ec31c92902 of volume 465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:43 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" returned: 0 in 0.277s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a6ca4-0573-4d14-8dd7-51914dfd0a21]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:43 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "cinder-quobyte-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2" released by "delete_volume" :: held 0.722s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Created reservations ['566d7641-7d37-4b31-a7df-7b87ab3cc4e1', '4e06ddb7-4ba7-4022-aeb1-83182d0e443a', 'b54241b0-a89b-4363-b40a-cd10bd9f182c', '42c26d94-998c-41f0-8f78-05278d3256b5'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:44 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c Sep 25 13:03:44 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:44 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:44 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:44 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c" returned: 0 in 0.408s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:44 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 1G Sep 25 13:03:44 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:44 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.281s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:44 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Deleted volume successfully. Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3ca8176b-2d8c-4560-8235-044147a59865 tempest-ProjectReaderTests-2701813 None] Lock "cinder-53d9c6aa-9b74-481e-b0dc-06dd3468a8c2-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:44 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 1G" returned: 0 in 0.454s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:44 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465517f3-4729-4fef-a00d-545c75e6ae2c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:44 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465517f3-4729-4fef-a00d-545c75e6ae2c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 Sep 25 13:03:44 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:45 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465517f3-4729-4fef-a00d-545c75e6ae2c -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902" returned: 0 in 0.346s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:45 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 is being set with open permissions: ugo+rw Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 Sep 25 13:03:45 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:45 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902" returned: 0 in 0.288s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info Sep 25 13:03:45 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:45 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info" returned: 0 in 0.308s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:45 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info is being set with open permissions: ugo+rw Sep 25 13:03:45 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info Sep 25 13:03:45 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:46 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.info" returned: 0 in 0.304s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:46 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:46 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-72b482f9-bb04-4312-ad30-4c445463a21c tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-ba96bc2a-f403-4d2a-8bb5-10ec31c92902-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-ba96bc2a-f403-4d2a-8bb5-10ec31c92902-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-ba96bc2a-f403-4d2a-8bb5-10ec31c92902" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-ba96bc2a-f403-4d2a-8bb5-10ec31c92902" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot ba96bc2a-f403-4d2a-8bb5-10ec31c92902 of volume 465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[570eec76-73ca-4399-b155-54f960e5a113]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:47 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 Sep 25 13:03:47 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.247s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:03:47 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902" returned: 0 in 0.363s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465517f3-4729-4fef-a00d-545c75e6ae2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9f3ff-4440-4ad3-91e2-88cb17917ea6]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c Sep 25 13:03:47 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c" returned: 0 in 0.339s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 Sep 25 13:03:47 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:48 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:48 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902 Sep 25 13:03:48 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:48 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c.ba96bc2a-f403-4d2a-8bb5-10ec31c92902" returned: 0 in 0.250s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-ba96bc2a-f403-4d2a-8bb5-10ec31c92902" released by "_delete_snapshot" :: held 1.418s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" released by "delete_snapshot" :: held 1.440s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Created reservations ['39e28ca5-4cce-4fa4-aa90-23313b9c76ca', '37a08bec-e301-46af-8875-e055f9a931ae', '25a4e33d-6acf-4a87-b0ad-c7ed6a8c8fa3', '733a60c8-e626-4239-a3de-aa46bae9abe0'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:48 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:03:48 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-28eb53bd-0e8c-40b3-ba8c-1e539551db5b tempest-ProjectMemberTests-345174882 None] Lock "cinder-ba96bc2a-f403-4d2a-8bb5-10ec31c92902-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-465517f3-4729-4fef-a00d-545c75e6ae2c-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "cinder-465517f3-4729-4fef-a00d-545c75e6ae2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a918cde-38c5-491d-8ec4-44ad09dab810]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:49 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c Sep 25 13:03:49 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:49 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c" returned: 0 in 0.413s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:49 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:49 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c Sep 25 13:03:49 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:50 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-465517f3-4729-4fef-a00d-545c75e6ae2c" returned: 0 in 0.265s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-465517f3-4729-4fef-a00d-545c75e6ae2c" released by "delete_volume" :: held 0.755s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Created reservations ['0c0aafcd-487e-4466-ad0e-3a15ef5e0bbd', '22f9fd2b-ac4c-47c0-a99f-b57b1a109956', 'e0cfc314-b717-457c-95cb-02ed01190b38', '4639705c-1014-49db-9a70-7f4f444c51b8'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:50 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:50 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:50 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:50 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-35d104a1-6bc0-438b-8820-bf32d40bdd70 tempest-ProjectMemberTests-345174882 None] Lock "cinder-465517f3-4729-4fef-a00d-545c75e6ae2c-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (3c0d6a85-5998-4421-a1f9-e29d46f17e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2722d730-5e1b-4316-8b7b-e0c6f3c92db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2722d730-5e1b-4316-8b7b-e0c6f3c92db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258861731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6361f7f-530a-4c3c-9c3e-4cecac789ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:51Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e964fc6-65c3-484a-9daf-4e91da6105be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e964fc6-65c3-484a-9daf-4e91da6105be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903fd467-1011-4dff-91cc-ffbb2e34908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903fd467-1011-4dff-91cc-ffbb2e34908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6361f7f-530a-4c3c-9c3e-4cecac789ad6', 'volume_name': 'volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5617bcb4-1843-44ac-8c31-1281c103bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5617bcb4-1843-44ac-8c31-1281c103bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4023133-bf79-462b-be7b-acd14c01b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:50 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Volume e6361f7f-530a-4c3c-9c3e-4cecac789ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6', 'volume_size': 1} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258861731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6361f7f-530a-4c3c-9c3e-4cecac789ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:51Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Creating volume e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:50 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:51 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:51 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 1073741824 Sep 25 13:03:51 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:51 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 1073741824" returned: 0 in 0.444s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:51 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 Sep 25 13:03:51 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:51 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" returned: 0 in 0.253s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4023133-bf79-462b-be7b-acd14c01b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431ecad-a71a-473a-9deb-0407915575fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:51 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Volume volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 (e6361f7f-530a-4c3c-9c3e-4cecac789ad6): created successfully Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431ecad-a71a-473a-9deb-0407915575fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:51 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (3c0d6a85-5998-4421-a1f9-e29d46f17e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:51 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-17536a35-0082-444d-a613-f04154968e6f tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Creating offline snapshot 9be0e5a6-724c-41b4-a6e8-d5119953d738 of volume e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267dfcd-9aaf-4b3b-a174-87b0bead8de5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:52 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 Sep 25 13:03:52 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:52 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" returned: 0 in 0.385s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:52 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 1G Sep 25 13:03:52 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:52 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 1G" returned: 0 in 0.431s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:52 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:52 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 Sep 25 13:03:52 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:53 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:53 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 is being set with open permissions: ugo+rw Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:53 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 Sep 25 13:03:53 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:53 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738" returned: 0 in 0.267s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:53 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info Sep 25 13:03:53 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:53 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info" returned: 0 in 0.253s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:53 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info is being set with open permissions: ugo+rw Sep 25 13:03:53 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:53 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info Sep 25 13:03:53 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:54 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.info" returned: 0 in 0.252s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:54 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-809048ed-3f6f-4fd5-840c-f1ee963ff71d tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-9be0e5a6-724c-41b4-a6e8-d5119953d738-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-9be0e5a6-724c-41b4-a6e8-d5119953d738-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-9be0e5a6-724c-41b4-a6e8-d5119953d738" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-9be0e5a6-724c-41b4-a6e8-d5119953d738" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot 9be0e5a6-724c-41b4-a6e8-d5119953d738 of volume e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[11943651-c0be-4f52-a9e3-bfd5823d653d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:54 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 Sep 25 13:03:54 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:54 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738" returned: 0 in 0.350s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b3a20c-826c-470b-809f-62ec759bd8a3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:54 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:54 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 Sep 25 13:03:54 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:55 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" returned: 0 in 0.379s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:55 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 Sep 25 13:03:55 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:55 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738" returned: 0 in 0.378s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:55 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738 Sep 25 13:03:55 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:55 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6.9be0e5a6-724c-41b4-a6e8-d5119953d738" returned: 0 in 0.280s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-9be0e5a6-724c-41b4-a6e8-d5119953d738" released by "_delete_snapshot" :: held 1.483s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" released by "delete_snapshot" :: held 1.504s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Created reservations ['a01a5ece-9cb2-4bfe-b0bf-c311c1dfbc4d', '5a516ba9-55f5-42c8-b914-7d466abe21bc', 'f204def4-5aae-46cb-a2af-c95674011d78', 'e3aa162a-7023-4ab9-9564-d591ff823e66'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:55 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:03:55 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2ec7dabe-296a-4754-ac72-ac2d167f0a37 tempest-ProjectMemberTests-345174882 None] Lock "cinder-9be0e5a6-724c-41b4-a6e8-d5119953d738-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-e6361f7f-530a-4c3c-9c3e-4cecac789ad6-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "cinder-e6361f7f-530a-4c3c-9c3e-4cecac789ad6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" acquired by "delete_volume" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[243df4f3-c299-41f5-8d29-78c4d28e638a]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:56 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 Sep 25 13:03:56 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:56 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" returned: 0 in 0.353s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:56 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:56 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6 Sep 25 13:03:56 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:57 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" returned: 0 in 0.242s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-e6361f7f-530a-4c3c-9c3e-4cecac789ad6" released by "delete_volume" :: held 0.657s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Created reservations ['a5f813f2-ed00-47a4-88be-5b164df07375', '7601645c-7e47-4455-b61b-a1b752182f96', '35c5b066-9225-424a-8bc6-8b6a3bb564b9', '26e1465f-821e-456b-8445-9ca86d9e88eb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:57 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:03:57 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:57 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.241s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:57 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:03:57 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-997e9120-2dd8-4c32-be9f-6b57f8f550fe tempest-ProjectMemberTests-345174882 None] Lock "cinder-e6361f7f-530a-4c3c-9c3e-4cecac789ad6-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (f2e89a47-125e-4d76-93c7-4df984f6c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27fd883-775c-4af9-b6a8-55d7ce209a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27fd883-775c-4af9-b6a8-55d7ce209a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-117745966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1048846d-ce08-4a32-8396-b2ab09b688ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:58Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec5abb4-3dcc-4b4d-a274-01dc44897fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec5abb4-3dcc-4b4d-a274-01dc44897fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71b753-6ddd-468a-a152-a42103a403eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71b753-6ddd-468a-a152-a42103a403eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1048846d-ce08-4a32-8396-b2ab09b688ed', 'volume_name': 'volume-1048846d-ce08-4a32-8396-b2ab09b688ed', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75935640-2dbc-49b1-8c67-2dfe6edd4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75935640-2dbc-49b1-8c67-2dfe6edd4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3da2fb-dc58-47d1-92e9-c72c868723ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Volume 1048846d-ce08-4a32-8396-b2ab09b688ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1048846d-ce08-4a32-8396-b2ab09b688ed', 'volume_size': 1} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-117745966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1048846d-ce08-4a32-8396-b2ab09b688ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:58Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Creating volume 1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:58 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:58 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed 1073741824 Sep 25 13:03:58 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:58 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed 1073741824" returned: 0 in 0.417s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:58 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed Sep 25 13:03:58 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:58 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed" returned: 0 in 0.266s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3da2fb-dc58-47d1-92e9-c72c868723ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1048846d-ce08-4a32-8396-b2ab09b688ed', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621925a9-a901-47b8-80d2-f150e34722fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:58 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Volume volume-1048846d-ce08-4a32-8396-b2ab09b688ed (1048846d-ce08-4a32-8396-b2ab09b688ed): created successfully Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621925a9-a901-47b8-80d2-f150e34722fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:58 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (f2e89a47-125e-4d76-93c7-4df984f6c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:58 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-a9870922-32dd-4a7e-94f0-658868d8b36c tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Creating offline snapshot 97b27b6c-8471-4ce0-a9e3-92f6b99b622e of volume 1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0429b85-926e-4cb7-a6ef-c468e98c8481]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:59 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed Sep 25 13:03:59 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:59 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed" returned: 0 in 0.383s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:59 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:59 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e 1G Sep 25 13:03:59 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:00 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e 1G" returned: 0 in 0.403s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1048846d-ce08-4a32-8396-b2ab09b688ed -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:00 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1048846d-ce08-4a32-8396-b2ab09b688ed -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e Sep 25 13:04:00 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:00 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1048846d-ce08-4a32-8396-b2ab09b688ed -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e" returned: 0 in 0.316s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e is being set with open permissions: ugo+rw Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:00 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e Sep 25 13:04:00 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:00 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e" returned: 0 in 0.237s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:00 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info Sep 25 13:04:00 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:00 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info" returned: 0 in 0.242s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:00 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info is being set with open permissions: ugo+rw Sep 25 13:04:00 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:00 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info Sep 25 13:04:00 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:01 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.info" returned: 0 in 0.246s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:01 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f78a38b7-c86e-4639-88ca-656394ce1e5c tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-97b27b6c-8471-4ce0-a9e3-92f6b99b622e-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-97b27b6c-8471-4ce0-a9e3-92f6b99b622e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-97b27b6c-8471-4ce0-a9e3-92f6b99b622e" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-97b27b6c-8471-4ce0-a9e3-92f6b99b622e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot 97b27b6c-8471-4ce0-a9e3-92f6b99b622e of volume 1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1436a8-ece3-4c27-ba45-d02fbb9eef46]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:01 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e Sep 25 13:04:01 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:01 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e" returned: 0 in 0.380s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1048846d-ce08-4a32-8396-b2ab09b688ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d38e1-b929-4953-9caa-1e34e5f30dd5]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:01 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:02 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed Sep 25 13:04:02 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:02 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed" returned: 0 in 0.420s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:02 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e Sep 25 13:04:02 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:02 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e" returned: 0 in 0.362s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:02 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e Sep 25 13:04:02 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:02 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:02 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed.97b27b6c-8471-4ce0-a9e3-92f6b99b622e" returned: 0 in 0.264s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-97b27b6c-8471-4ce0-a9e3-92f6b99b622e" released by "_delete_snapshot" :: held 1.529s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" released by "delete_snapshot" :: held 1.553s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Created reservations ['322bdccb-37b9-4914-aa11-664b69e29173', '6d6e4275-46bc-4f82-b0de-440397e5050d', 'dbcb145d-b03f-4a8b-9c4f-c3a1e3afd951', 'ad7384eb-7442-455b-ab8f-e9bdfd7a7a5a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:03 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-637a6543-3f25-435b-92bd-33e0e1f89334 tempest-ProjectMemberTests-345174882 None] Lock "cinder-97b27b6c-8471-4ce0-a9e3-92f6b99b622e-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-1048846d-ce08-4a32-8396-b2ab09b688ed-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "cinder-1048846d-ce08-4a32-8396-b2ab09b688ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" acquired by "delete_volume" :: waited 0.017s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[96811194-0cb1-4e13-b9a6-3fadc3d8cb4e]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:03 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:03 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed Sep 25 13:04:03 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:04 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed" returned: 0 in 0.368s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:04 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed Sep 25 13:04:04 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:04 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-1048846d-ce08-4a32-8396-b2ab09b688ed" returned: 0 in 0.261s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-1048846d-ce08-4a32-8396-b2ab09b688ed" released by "delete_volume" :: held 0.692s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Created reservations ['4b2757e4-791c-433a-8ffe-39a62f809917', '5d49861e-b616-4dc3-bba0-84edbf7dfd5e', '9ab6f54e-7533-44a7-80e5-d7b953dbb9ce', 'fd172c1e-67e5-4488-8166-e2784ed1db03'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:04 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:04:04 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:04 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.264s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:04 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:04:04 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-09103a0c-a048-41a5-bb9e-30e49b67145d tempest-ProjectMemberTests-345174882 None] Lock "cinder-1048846d-ce08-4a32-8396-b2ab09b688ed-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (e596a308-7092-4d9f-8000-ae618e8f9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5383fb4c-4efa-438a-9449-a6425bd8c9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5383fb4c-4efa-438a-9449-a6425bd8c9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486929142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a82c0ca-8884-478c-a98e-f95aab81ea15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:05Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec81a4d-da42-4dff-9b7d-58ebc546b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec81a4d-da42-4dff-9b7d-58ebc546b79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c482f3a2-6beb-4f7f-8fcb-2f8fa31d665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c482f3a2-6beb-4f7f-8fcb-2f8fa31d665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a82c0ca-8884-478c-a98e-f95aab81ea15', 'volume_name': 'volume-4a82c0ca-8884-478c-a98e-f95aab81ea15', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69bc037-6349-4398-add6-e11b61c07662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69bc037-6349-4398-add6-e11b61c07662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88a3540-7b67-4e20-a860-eb24259dc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:05 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Volume 4a82c0ca-8884-478c-a98e-f95aab81ea15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a82c0ca-8884-478c-a98e-f95aab81ea15', 'volume_size': 1} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486929142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a82c0ca-8884-478c-a98e-f95aab81ea15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:05Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Creating volume 4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:05 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:05 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 1073741824 Sep 25 13:04:05 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:05 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 1073741824" returned: 0 in 0.410s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:05 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:05 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 Sep 25 13:04:05 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:06 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15" returned: 0 in 0.251s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88a3540-7b67-4e20-a860-eb24259dc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a82c0ca-8884-478c-a98e-f95aab81ea15', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d9e81-1183-4c82-8e97-ab7140a3914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:06 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Volume volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 (4a82c0ca-8884-478c-a98e-f95aab81ea15): created successfully Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d9e81-1183-4c82-8e97-ab7140a3914b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (e596a308-7092-4d9f-8000-ae618e8f9db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:06 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-f6aa9aeb-15af-41d8-99f4-f265588714b2 tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Creating offline snapshot b7e1bcee-ad98-46b2-93b8-2e1da136dd6b of volume 4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b466fc-9f4b-49b9-95a8-dbceaa81be94]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:06 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 Sep 25 13:04:06 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:06 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15" returned: 0 in 0.375s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:06 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:06 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b 1G Sep 25 13:04:06 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:07 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b 1G" returned: 0 in 0.387s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:07 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b Sep 25 13:04:07 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:07 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" returned: 0 in 0.311s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:07 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b is being set with open permissions: ugo+rw Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:07 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b Sep 25 13:04:07 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:07 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" returned: 0 in 0.243s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:07 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:07 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info Sep 25 13:04:07 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:08 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info" returned: 0 in 0.252s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:08 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info is being set with open permissions: ugo+rw Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:08 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info Sep 25 13:04:08 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:08 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.info" returned: 0 in 0.245s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:08 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3dfd7e36-832b-4058-8775-6a49e73c6c39 tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot b7e1bcee-ad98-46b2-93b8-2e1da136dd6b of volume 4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b9f2e-0883-43c2-b6ce-d5673b3b626d]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:08 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:08 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b Sep 25 13:04:08 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" returned: 0 in 0.379s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a82c0ca-8884-478c-a98e-f95aab81ea15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095a1b1-0f07-4f26-b83b-09a5af497f55]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 Sep 25 13:04:09 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b Sep 25 13:04:09 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" returned: 0 in 0.312s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b Sep 25 13:04:09 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15.b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" returned: 0 in 0.247s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b" released by "_delete_snapshot" :: held 1.410s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" released by "delete_snapshot" :: held 1.433s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Created reservations ['fcd339ac-51c9-48cf-8bb8-52133b648619', 'eccf65df-ce12-4f82-9219-371110fc4015', 'a0d9d25a-cd58-4934-bb86-477b1ad95e23', 'e049c130-dd68-4d63-aefc-c01cfd19caed'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:10 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-e3a6fb28-6028-4616-97f7-b87ca60a6776 tempest-ProjectMemberTests-345174882 None] Lock "cinder-b7e1bcee-ad98-46b2-93b8-2e1da136dd6b-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-4a82c0ca-8884-478c-a98e-f95aab81ea15-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "cinder-4a82c0ca-8884-478c-a98e-f95aab81ea15-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" acquired by "delete_volume" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08535fd-b8b4-442e-8c3d-9373ad3e10a0]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:10 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:10 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 Sep 25 13:04:10 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15" returned: 0 in 0.401s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:11 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15 Sep 25 13:04:11 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-4a82c0ca-8884-478c-a98e-f95aab81ea15" returned: 0 in 0.248s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-4a82c0ca-8884-478c-a98e-f95aab81ea15" released by "delete_volume" :: held 0.711s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Created reservations ['c91b4240-f6b4-4b5d-ad3e-38a5a747154b', 'aad5f879-b0a1-4201-aee4-28aba8a56a71', '6e01f9e2-2f4d-4976-ac8b-8c0698d64fb6', '4d210165-21fb-4be7-b168-03a61001c4e9'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:11 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:04:11 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.261s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:11 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:04:11 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-3853099f-558a-4440-8870-706755fbe346 tempest-ProjectMemberTests-345174882 None] Lock "cinder-4a82c0ca-8884-478c-a98e-f95aab81ea15-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.flows.manager.create_volume [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87094) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (7cc9362d-a0b2-4cca-bcec-461e7ec8bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db5fef0-5de6-4503-9cd3-ade5f8a189d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db5fef0-5de6-4503-9cd3-ade5f8a189d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120009695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9321ce2-8a3f-439f-b1d5-49f0b1da4295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:12Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4c08b5-ba55-4d49-a18c-745e844193f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4c08b5-ba55-4d49-a18c-745e844193f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5db88b8-402d-4863-9b86-e50007b0e7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5db88b8-402d-4863-9b86-e50007b0e7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9321ce2-8a3f-439f-b1d5-49f0b1da4295', 'volume_name': 'volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e519c5-636e-45b2-b498-d5454562aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e519c5-636e-45b2-b498-d5454562aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7ba4b5-6ce1-4a79-a163-49eda43af6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Volume f9321ce2-8a3f-439f-b1d5-49f0b1da4295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295', 'volume_size': 1} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2120009695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9321ce2-8a3f-439f-b1d5-49f0b1da4295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba07bce12040404eb92f12970442561c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:12Z,use_quota=True,user_id='3f1bd9a81cc14892990d2d28cbd41e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1521fae-5361-418b-875d-970e070750d6),volume_type_id=c1521fae-5361-418b-875d-970e070750d6)}" {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Creating volume f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Selected osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 as target Quobyte volume. {{(pid=87094) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:12 devstack cinder-volume[87094]: INFO cinder.volume.drivers.remotefs [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] casted to osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0 Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 1073741824 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 1073741824 Sep 25 13:04:12 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 1073741824" returned: 0 in 0.448s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:12 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 Sep 25 13:04:12 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:13 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" returned: 0 in 0.256s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'} {{(pid=87094) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7ba4b5-6ce1-4a79-a163-49eda43af6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295', 'volume_size': 1}' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22efbb5a-aa66-4031-a7c1-a46caf7e0928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:13 devstack cinder-volume[87094]: INFO cinder.volume.flows.manager.create_volume [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Volume volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 (f9321ce2-8a3f-439f-b1d5-49f0b1da4295): created successfully Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22efbb5a-aa66-4031-a7c1-a46caf7e0928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87094) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Flow 'volume_create_manager' (7cc9362d-a0b2-4cca-bcec-461e7ec8bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87094) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:13 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-508a4043-4392-4e33-94dc-bd33691a1363 tempest-ProjectMemberTests-345174882 None] Created volume successfully. Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Creating offline snapshot 48cbce8f-bbc2-4684-b796-581cf07de086 of volume f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237a676-7e0e-4dde-a8bf-8b7079ab0f40]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 Sep 25 13:04:13 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:13 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" returned: 0 in 0.375s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 1G {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 1G Sep 25 13:04:13 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 1G" returned: 0 in 0.468s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:14 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 Sep 25 13:04:14 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 -F qcow2 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086" returned: 0 in 0.320s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:14 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 is being set with open permissions: ugo+rw Sep 25 13:04:14 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:14 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 Sep 25 13:04:14 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086" returned: 0 in 0.283s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=155,cinder:INSERT=51,cinder:UPDATE=207,cinder:DELETE=18 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=137,cinder:INSERT=55,cinder:UPDATE=192,cinder:DELETE=14 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info Sep 25 13:04:15 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info" returned: 0 in 0.266s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87094]: WARNING cinder.volume.drivers.remotefs [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info is being set with open permissions: ugo+rw Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info Sep 25 13:04:15 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.info" returned: 0 in 0.251s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:15 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-04ac5381-b6b6-4932-a818-bd242ddb3b92 tempest-ProjectMemberTests-345174882 None] Create snapshot completed successfully Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-48cbce8f-bbc2-4684-b796-581cf07de086-delete_snapshot" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-48cbce8f-bbc2-4684-b796-581cf07de086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" by "delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-48cbce8f-bbc2-4684-b796-581cf07de086" by "_delete_snapshot" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-48cbce8f-bbc2-4684-b796-581cf07de086" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Deleting offline snapshot 48cbce8f-bbc2-4684-b796-581cf07de086 of volume f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] snapshot_file for this snap is: volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531e198-b94e-485b-bd5a-e17b0d8848d3]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:16 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 Sep 25 13:04:17 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086" returned: 0 in 0.365s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.remotefs [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87094) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a645add-2a21-4035-b86e-57e31b72b657]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 Sep 25 13:04:17 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" returned: 0 in 0.369s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 Sep 25 13:04:17 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:18 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086" returned: 0 in 0.371s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:18 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086 Sep 25 13:04:18 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:18 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295.48cbce8f-bbc2-4684-b796-581cf07de086" returned: 0 in 0.252s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-48cbce8f-bbc2-4684-b796-581cf07de086" released by "_delete_snapshot" :: held 1.452s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" released by "delete_snapshot" :: held 1.472s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Created reservations ['43398a6c-52c7-47ca-b087-b83469d82dc5', '9a9db0f6-6241-47b9-8577-463c55a78c9a', 'b8cd975e-4f22-4a11-8063-779e21b88b81', '424792eb-2f1b-475f-a984-c6d2f4349b9a'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:18 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Delete snapshot completed successfully. Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-2b9e26b5-b295-4f80-bb6f-c5234b954d12 tempest-ProjectMemberTests-345174882 None] Lock "cinder-48cbce8f-bbc2-4684-b796-581cf07de086-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:18 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-f9321ce2-8a3f-439f-b1d5-49f0b1da4295-delete_volume" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "cinder-f9321ce2-8a3f-439f-b1d5-49f0b1da4295-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Acquiring lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" by "delete_volume" {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" acquired by "delete_volume" :: waited 0.022s {{(pid=87094) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c459f10-f4c7-4a2b-b8b9-cdee4f6bea90]: (4, 'qcow2') {{(pid=88345) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 Sep 25 13:04:19 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" returned: 0 in 0.430s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295 Sep 25 13:04:19 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197/volume-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" returned: 0 in 0.256s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "cinder-quobyte-f9321ce2-8a3f-439f-b1d5-49f0b1da4295" released by "delete_volume" :: held 0.750s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.quota [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Created reservations ['48141604-8329-4670-bae0-036b4820bb6a', '583c09d4-1fd1-4452-93b8-938c9e07da9d', '354c9ad8-23f2-4f2b-85ed-b049d73dc11d', '2104ef70-f655-4d22-8861-a3eeec4e7bfb'] {{(pid=87094) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:19 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:04:19 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.321s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:20 devstack cinder-volume[87094]: INFO cinder.volume.manager [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Deleted volume successfully. Sep 25 13:04:20 devstack cinder-volume[87094]: DEBUG cinder.coordination [None req-63b719fb-43d7-4908-adff-ddd064c9a6f8 tempest-ProjectMemberTests-345174882 None] Lock "cinder-f9321ce2-8a3f-439f-b1d5-49f0b1da4295-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87094) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:29 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=16 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:30 devstack cinder-volume[87094]: DEBUG dbcounter [-] [87094] Writing DB stats cinder:DELETE=2,cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=87094) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0': None} {{(pid=87094) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG cinder.volume.drivers.quobyte [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e007fc68-6e01-4f20-a31f-343d21b419b0'] {{(pid=87094) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.lockutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87094) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:47 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197 Sep 25 13:04:47 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:47 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_concurrency.processutils [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e18e5351e6de75e492cc09d8c9e23197" returned: 0 in 0.348s {{(pid=87094) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG cinder.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Notifying Schedulers of capabilities ... {{(pid=87094) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG oslo_service.periodic_task [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] Running periodic task VolumeManager._thread_info {{(pid=87094) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread count: 28 {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:04:47 devstack cinder-volume[87094]: DEBUG cinder.volume.manager [None req-a89d02c9-e927-41ec-b0ef-fa3b87ebd40a None None] thread info: [<_MainThread(MainThread, started 138587036541056)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87094) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}